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ABSTRACT 



This report presents a computational model -^J^M^^^Y 
makes possible a precise descnpt ion of pa ralUl c omp st 

complexity on non-.tructured * ata In ^V^^ Un £ 9 re prescnt 
are represented by the nodes of a dree tea gr ay w -^^- trol in forma- 

the elements of storage and ^nB^B^nc£^^A/or£^^ 
tion. The activation of the comimtefaon reprt J nt *** V {nc J ent into 

only on the control W^^ numVertf nodes may be active, 
and out of the node. At any given time ^ y either the length of 

and there are no assumptions m ** ™** J***™^"^ a node or the 
time required to perform the computa -^/^^^jLticn from one 
length of time required to transmit data or cont roi i he model 

node to another. Data dependent decisions are J»«r^r seqU enc- 

in a novel way which makes a sharp di-tinchon be^e ation 

s P 72^ -- by *. ^« 

structure of the algorithm. 

The concept of the ^f^^Sc-^ ^ 
that every program graph "presents a SgggBffiLJL- * ^ state 

that the final state of each computation star |^ f r °£» are defined in 
is unique. Computations whxch do not temmate proper^ ^ developed 
terms of the concept of hangup state Method! » °J ™ ^ hang-up states 
and necessary and sufficient condltlon n S t /°Ve t edL terms of the structure 
are obtained. These conditions »".^« r £? l ~^ e \2S BtB are imbedded 

° n St^^s^^^ r gram graphs 

is fo1mu£ed\nd a solution to this problem is presented. 
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PREFACE 

The goals of generalized computer-aided design, being synonymous 
with generalized man-machine problem-solving, place the most stringent 
requirements on underlying foundations and implementation techniques. 
As increasingly elaborate and complex applications are contemplated, it 
becomes clear that substantial inroads must be made to deepen our funda- 
mental understanding of computation itself. Ultimately it must be possible 
to prove the correctness of a program, for no conceivable technique can 
provide an adequate basis for debugging; it must be possible to transform 
proposed computation automatically from one formulation to another 
adically different formulation, with firm knowledge that the two forms 
re in a useful way equivalent; it must be possible to design, analyze, 
nd compute using entire computational processes themselves as data, for 
manual composition of constructs of such vast complexity will be beyond 
human comprehension. It was in the spirit of these convictions that the 
research described in this report was undertaken. 

Early in the preliminary investigation, it became clear that before 
any questions of equivalence or operations of transformation could mean- 
ingfully be posed, a rigorous, deterministic, and elegant model of a com- 
putational process itself was required. The model had to be independent 
of any artifacts of existing programming language characteristics and had 
to exhibit in an inherently simple and natural form only the essential rela- 
tions between data and operators on data, from which any computational 
process is composed. The "program graph" model introduced here is a 
major contribution which meets the most basic criteria. Since the model 
is based directly upon "data dependency" relations, it enjoys the essential 
simplicity needed to assure its adequacy as a general model. Also, the 
rigorous formulation enables determinism of the model to be proved. 
Finally, some initial attempts to address questions of equivalence and 
transformation lend credence to the viewpoint that further elaborations and 
refinements can lead toward the desired basis for a mathematics for com- 
putational processes. Already the trends in this direction are taking shape 
in a number of related theses and studies listed at the end of this preface. 
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PREFACE (Contd.) 

In view of the abstract nature of the model, and the fact that such 
important features as data structures are included only in the most 
degenerate form, it is clear that it still will be some time before these 
developments can have a direct impact on the practical matters of con- 
structing man-machine systems. Many aspects can, however, be 
extracted and can be cast in terms compatible with some of the more 
advanced aspects of programming language semantics and compilation 
of optimized machine code. Hopefully such application attempts com- 
bined with the theoretical advancements will accelerate the pace at 
which these vital matters can be pursued. 



Douglas T . Ross 

Head, Computer Applications Group 

January, 1969 
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I. INTRODUCTION 

A. SUMMARY 

This paper presents a computational model called program graphs 
which makes possible a precise description of parallel computations of 
arbitrary complexity on non-structured data. In the model, the computa- 
tion steps are represented by the nodes of a directed graph whose links 
represent the elements of storage and transmission of data and/ or control 
information. The activation of the computation represented by a node de- 
pends only on the control information residing in each of the links incident 
into and out of the node. At any given time any number of nodes may be 
active, and there are no assumptions in the model regarding either the 
length of time required to perform the computation represented by a node 
or the length of time required to transmit data or control information 
from one node to another. Data dependent decisions are incorporated in 
the model in a novel way which makes a sharp distinction between the 
local sequencing requirements arising from the data dependency of the 
computation steps and the global sequencing requirements determined by 
the logical structure of the algorithm. 

The concept of the state of a program graph is introduced and it 
is proved that every program graph represents a deterministic computa- 
tion, i. e. that the final state of each computation started from the same 
initial state is unique. Computations which do not terminate properly are 
defined in terms of the concept of hang-up state. Methods of analysis are 
developed, and necessary and sufficient conditions for the absence of hang- 
up states are obtained. These conditions are interpreted in terms of the 
structure of the graph and the manner in which the decision elements are 
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imbedded in that structure. Finally, an equivalence problem for program 
graphs is formulated and a solution to this problem is presented. 

The model may be useful in a variety of problems including: the 
I analysis and transformation of computer programs to meet some desired 
criterion, e. g. reduce the amount of space required, or increase the 
speed of operation, or both of these objectives; the assignment and 
sequencing of computations in parallel processor computer systems; and 
the design of sequencing and control units for parallel computation, in 

particular, the results of this paper are directly applicable to the design 

3 18 22 
of macro -modular systems. ' ' 

B. REVIEW OF RELATED WORK 

Graphs have been used to represent computations since the early 

days of computers. Most of these representations are strictly sequential 

and can be generally classified as flow charts. In a flow chart, a node 

represents either an operational element or a decision element, and an 

arc of the graph denotes flow of control from one node to another. At 

any one point, control resides in precisely one of the nodes. Flow charts 

v, u .. j- ^ u v. * i ■ *u c ,^2, 4,5,8, 9, 11, 13,20 

have been studied by a number of workers in the field. 

In the context of this paper, these studies are not directly relevant and 

therefore we proceed to review only those models which have a direct 

bearing on the subject of parallel computations. 

19 
C. A. Petri has proposed an approach to the description of 

transmission and transformation of information in discrete systems in 

which time is introduced only as a local relation among local states. In 

Petri' 8 formalism, a system is represented by an undirected graph in 

which each node is a connecting element which binds together (relates) 

objects contained in places. Each arc of the graph is a place. A node 



-3- 
represents a switching element of a type given by its label. The behavior 
of each type of element is given by a transition table and is influenced only 
by those objects assigned to places attached to the node. Petri claims that 
it is possible to construct conflict-free, deterministic networks corres- 
ponding to Turing machines using switching elements defined over the 
objects and 1. 

■7 

A. W. Holt has introduced a formalism called -theory for des- 
cribing discrete information systems. In a -theory the characteristics 
and behavior of a system are expressed by means of relations of parts. The 
state of a system is formalized as a finite undirected graph. The nodes of 
the graph represent system parts and every node is labelled with a node type. 
The arcs represent relations between two parts. A -theory consists of a 

-grammar , a list of event types , and a list of observables . The grammar 
establishes the laws of local context for the node types, i. e. what node types 
must or may relate and how. The list of event types establishes the laws 
of local change, i. e. which relations of parts bring about which changes in 
relations of parts. The list of observables defines which relations of parts 
are capable of conditioning events in the environment of a system of the 
class. Changes on the state of a system are defined by means of a simula - 
tion rule which effects the changes specified by an admissible subset of 
applicable event types. A subset of applicable event types is admissible 
if it is consistent and lossless which means that the state resulting from 
the changes obeys the rules of the grammar, no two events bring about 
conflicting changes, and every applicable event not contained in the admis- 
sible subset remains applicable after the changes are effected. 

23 
E. C. Van Horn has proposed a class of abstract machineo for 

coordinated multi -processing or MCM. An MCM consists of a set of cells , 

a scheduler, and a count matrix. The state of an MCM is defined to be the 
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contentB of the calls plus the contents of the count matrix. Each cell may 
behave either like a passive memory element or an active computing 
element. An active cell, called a clerk, may perform a sequence of 
transactions under the control of the scheduler. Each cell has its own 
table of transactions. There are five types of transactions; two trans- 
actions read and write on cells, three transactions modify the count 
matrix. Reading of the count matrix is performed by the scheduler to 
determine which clerk cells are enabled, i. e. can perform one transaction. 
Van Horn has shown that the behavior of any MCM is asynchronously 

reproducible. 

R. M. Karp and R. E. Miller 1 have introduced a model for 
parallel computations, called computation graphs. A computation graph 
is a directed graph in which nodes denote operations and branches denote 
storage elements where results are placed in first-in-firet-out queues. 
Associated with each branch are four non-negative integers A , U p , W p , 

and T where T > W . For a branch directed from node n. to node n., these 
p p - p i J 

parameters are interpreted as follows: A is the number of data words 
initially in the queues; U is the number of words added to the queue upon 
completion of the operation associated with n £ ; and T is a threshold giving 
the minimum queue length of the branch before the operation of n. is 
initiated. Karp and Miller show that computations represented by these 
graphs are deterministic. They also give a test to determine whether a 
computation terminates, and study properties of the data queues associated 
with the branches, deriving conditions for the queue lengths to remain 
bounded. 
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G. Estrin and R. Turn, 6 and D. Martin 1 have introduced a 
directed graph model for computer programs in which the vertices 
represent computational tasks and the arcs represent data dependency 
between nodes. In this model, the conditions for the initiation of the 
computation denoted by a vertex is expressed by writing a boolean ex- 
pression in terms of boolean variables associated with the arcs incident 
into the node. A boolean variable associated with an arc is true when 
the data in that arc becomes available, A computation may be initiated 
when the boolean expression of the corresponding node, called the vertex 
input control, is true. There are three types of vertex input control: 
1) Conjunctive, 2) disjunctive, and 3) compound. Vertices with conjunc- 
tive input control may be initiated only when all input data are available. 
Vertices with disjunctive input control may be initiated only when precisely 
one set of input data (i. e. one arc) becomes available. The compound 
input control is a combination of the other two. Vertices also have output 
control which is used to specify the program flow from a vertex to a subset 
of its immediate successors. A vertex with conjunctive output control 
simultaneously makes data available at all of the arcs incident out of the 
vertex. A vertex with disjunctive output control makes data available at 
precisely one of its output arcs. Thus, it may be seen that vertices with 
disjunctive output control effectively perform data dependent decisions to 
control the program flow. The model can ' properly represent 
only cycle free graphs. It has been used primarily as a tool for the 

i 

a-priori assignment and sequencing of computation in parallel processor 

systems. 
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The model presented in this paper is a direct extension and formali- 
zation of the model of Estrin and Turn using notational techniques intro- 
duced by Petri. In extending the model of Estrin and Turn, the concept of 
pure control information is introduced so that decision elements do not 
transmit any data but only enabled or disable computations. Furthermore, 
node types have been introduced which make possible the unambiguous 
specification of cycles. The notational techniques of Petri have been 
very useful for precisely describing the behavior of the model in terms 
of local information alone. In this respect, the similarities between this 
form of specification of events and that proposed by Holt should be noticed. 

D. Muller and .W.. Bartky 17 have developed methods for the 
analysis of asynchronous sequential circuits. These methods proved of 
considerable value in the analysis of the determinism of program graphs. 

C. OUTLINE 

The material is organized as follows: in Chapter II the model is 
presented and it is proved that every computation represented by the 
model is deterministic. Chapter III begins with a detailed consideration 
of the function of each type of node together with reasons for the choices 
made in the specification of their behavior. This is followed with the 
introduction of the concept of hang -up state and a study of the conditions 
which give rise to these states. Chapter IV formulates an equivalence 
problem and presents a solution to it. This is followed with a brief con- 
sideration of some simple equivalence preserving transformations. Finally, 
Chapter V contains the conclusions and recommendations of this research. 



II. THE MODEL 

A. INTRODUCTION 

This chapter presents a model for computational processes called 
program graphs . A program graph is both a denotation of an algorithm 
and a realization of this algorithm by a process. The linguistic device 
used to denote operations and the links of the graph denote data and/or 
control flow among the operations. The realization of the algorithm by 
a process is accomplished by assigning certain rules of behavior to the 
program graph elements (nodes and links). These rules of behavior are 
such that each program graph is a special -purpose deterministic machine 
which realizes an algorithmic process. The term deterministic machine 
as used in this paper means that the behavior of the machine is ; always the 
same whenever identical data is presented to it at its input terminals. 

The material is organized as follows: Section B gives background 
for the model and the general viewpoint adopted in its formulation. Section 
C gives some necessary notation and introduces the elements used in con- 
structing program graphs. Section D specifies the syntax for constructing 
program graphs. Section E specifies the interpretation of program graphs 
and gives illustrative examples. Finally Section F contains a proof of the 
determinism of program graphs. 
B. BACKGROUND AND VIEWPOINT 

The formulation of program graphs as a computational model has 
been motivated by the common observation that a large fraction of the 
sequential constraints of a process can be completely specified by explicitly 
indicating the data dependency among the different parts of the process. 
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In other words, if the results of sub-process A are data for sub-process B, 
then A must be performed before B. If control is defined as that quantity 
which determines the sequencing aspects of a process, then data flow always 
carries with it control flow information. An obvious advantage of this 
manner of process specification is the absence of unnecessary sequential 
constraints, and thus the immediate appearance of any parallelism inherent 
in the process. This can be seen in the example of Figure 2. 1 which shows 
the representation of an algebraic computation by means of a directed graph 
in which the nodes denote operations and the directed links denote the data 
dependency. The potential parallelism of the two '•+' nodes is clearly 

evident. 

Data dependency is not sufficient to specify all the sequential con- 
straints of a process, however. Most computations include decisions which 
affect the sequencing of the process without introducing explicit data 
dependency. We can think of the simplest form of decision, a binary deci- 
sion, as generating pure control information which selects one out of two 
possible sequences. The decision does not affect the result of the computa- 
tions of either sequence but only whether or not the sequences of any parts of 
them should be performed. Figure 2. 2 shows how we might represent an 
ALGOL conditional expression. The diamond-shaped node denotes a decision 
selecting one of the additions to be performed as a prelude to the multiplica- 
tion operation. (Open arrowheads denote pure control flow. ) 

A computational model which exploits the control aspects of data 
dependency and thereby places in sharp contrast the unique functions of 
pure control information is a potentially useful base for exploring trans- 
formations of algorithms which preserve input/output relations, logical 
design of asynchronous machines, . and similar areas. 



(B + C) * (D + E) 




Fig. 2. 1 Representation of an Algebraic Computation 
by a Program Graph 
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F x IF A THEN B + C ELSE O + E 




Fig. 2.2 Representation of a Conditional Expression 
by a Program Graph 
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Directed graphs are a natural choice for representing the 
dependency relations we are interested in, but the static relationships 
represented by a graph are not sufficient to unambiguously determine 
dynamic behavior, particularly when dealing with cycles. Dynamic be- 
havior of the process represented by a graph is a crucial question which 
cannot adequately be handled by introducing a series of ad hoc global rules 
of interpretation. Therefore, it was decided to formalize a program graph 
as a formal machine, by having well-defined rules of behavior associated 
with each element of the graph, i. e. the nodes and links. By making these 
rules depend only on local information, i. e. by making them independent 
of the over -all structure of the graph, we achieve two things: 

1. Any graph constructed following a minimum of local inter- 
connection rules represents a process with unambiguous 
behavior. 

2. Each operation proceeds asynchronously with all others, so 
that any degree of parallelism, anticipating computations or 
control, can be expressed by the formalism. 
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C. THE CONSTITUENTS OF PROGRAM GRAPHS 

A program graph formally represents a computing machine. The 
computational elements of the machine are represented by the nodes of 
the graph, and elements for storage and transmission of data and control 
information are represented by the links of the graph. In what follows 
node shall be synonymous with computational element and link shall be 
synonymous with storage -and-transmission element. 

There are two types of links - a data link and a control link . 
Associated with both data and control links is a quantity called the link- 
status. At any given time the link-status of a link assumes precisely one 
out of the four possible values -1, 0, 1, 2. These values will be called 
disabled , idle, enabled , and blocked , respectively. 

Data links have in addition to link status, a property called data 
contents. No restrictions are placed on the nature of the data contents 
of a link. In the representation of program graphs data links are shown 
as heavy lines with black arrows, while control links are shown as light 
lines with open arrows. 

There are seven types of nodes differing from each other either in 
the kind of computation performed or in the logic used to activate the node. 
Nodes have specific points of attachment called connectors. The connectors 
of a node are distinguished as being either input or output connectors. 
Furthermore an input or output connector may be a data connector or a 
control connector. Data connectors are attached only to data links. 
Similarly, control connectors are attached only to control links. 

When the computation represented by a node is being performed, we 
say that the node is active. The activation of a node is determined by the 
link status of the data and control links attached to the connectors of the 
node. For brevity we often refer to the 'status of a connector' meaning the 
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link status of the link attached to the connector, even though a connector 
does not properly have a status. 

A node is in an active configuration when the statuses of its connectors 
is such that the node becomes active. The occurrence of an active configura- 
tion initiates a transition of arbitrary time length. Upon completion of the 
transition, the status of each connector (and perhaps the data contents of 
attached data links as well) are changed in a way specified by the transition 
table for that type of node. 

The transition table for a type of node specifies all of the active 
configurations of the node in terms of the statuses of the input and output 
connectors. For each active configuration the transition table also specifies 
the final configuration i. e. , the status of each connector after completion 
of the transition, and the change, if any, of the data contents of output data 
links. 

The specification of the transition table is simplified by certain 

19 
conventions and a notation adopted from the work of Petri. Each connector 

of the node is assigned a sequential number. A configuration is then rep- 
resented by writing the link status values from left to right in the sequence 
determined by the ordering assigned to the set of connectors. Thus the 
configuration 110 corresponds to a node with three connectors in which 
connector number 1 is in status 1, connector number 2 is in status 1, and 
connector number 3 is in status 0. A transition is denoted by writing the 
active configuration followed by ' — ', followed by the final configuration. 
If a transition changes the data contents of some link, an expression is 
written after the final configuration defining the new new value. Thus* the 
expression $1 — fj ($2, $3) means that the data contents of connector 1 is 
replaced with the result of applying function f, to the data contents of 
connectors 2 and 3. 



■14- 



Opcrator 

Data operator 
Function 



Identity 

Control operator 
And 



Or 



Selector 



Junction 





1 1 0-001 


$3~f($l,$2) 


1-1 0-0 0-1 




-1 10-0 0-1 




-1-1 0—0 0-1 




1 0— 1 1 


$2, $3— $1 


-10 0— 0-1-1 




1 10—001 




1-1 0—00-1 




-1 10—00-1 




-1-1 0-0 0-1 




1 10—001 




1-10—001 




-1 10—001 




-1-1 0—0 0-1 




(60-11 

1 10 0- 

|g 1-1 


if p($l f $2>=true 
if 0($l,$2>=false 


1-1 0-* 0-1-1 




110 0-0 0-1-1 




■1-1 0-0 0-1-1 




1-1 0-0 1 


$3— $1 


-1.10-0 1 


$3«-$2 


-1-1 0-0 0-1 





Table 2. 1 The Transition Tables of Program Graph Nodes 



15- 



I „oop Junction 




Loop Output 




Input Terminal 
Output Terminal 



1 
i 



1 


— 


2 2 1 


$4— $1 


1 1 


— 


2 12 1 


$4 — $1 


1 -] 


— 


2-121 


$4 — $1 


-1 


— 


2 2-1 




1 1 


— 


2 12-1 




-1 -1 


— 


2-1 2-1 




2 1 


— 


2 0-11 


$4— $2 


2-10 


— 


10 




1 1 


— 


1 


$3— $1 


1 -1 


0-— 


0-1 




-1 1 


— 


2 




-1 -1 


— 


2 




2 1 


— 


1 




2-1 


0-* 


0-10 










Table 2. 1 The Transition Tables of Program Graph Nodes 
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Table 2. 1 contains the transition tables for each type of node. A 
brief description of the characteristics of each type follows. 

1. Operators 

Operator nodes denote functions of one or more input arguments and 
one or more output values. An operator node all of whose inputs and out- 
puts arc data links is called a data operator. Similarly an operator all of 
whose inputs and outputs are control links is called a control operator. 
Every operator is either a data or a control operator. The data operator 
representing the identity function will always be denoted by the symbol T. 
The control operators representing logical disjunction and conjunction will 
always be denoted by the symbols ' V i and i A . respectively. These 
are the only control operators allowed in a program graph. 

2. Selectors 

Selector nodes denote decision-making elements. A selector is 
associated with a predicate function. All inputs of a selector are data links 
and there are precisely two control outputs. When the predicate associated 
with a selector is applied to the data contents of the inputs the result is to 
place one output connector in enabled status and the other in disabled status. 

Selectors and data operators may have a control input connector in 
addition to their data connectors. The function denoted by a selector or 
data operator is applied only for those active configurations in which all 
input connectors are in enabled status. 

3. Junctions 

Junction nodes merge two or more sources of data. A junction 
transmits the data contents of at most one of its data inputs to its unique 
data output. 
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4. Loop Junction 

Loop junction nodes are used to form cyclic structures in a program 
graph. Their function can be roughly described as follows: Suppose one 
has an iterative process and A, B, C represent the quantities on which the 
iteration depends, then to every oneof these variables there will correspond 
a loop junction. Input connector 1 is used to 'assign' the initial value of the 
variable and input connector 2 is used to 'assign' the new value of the 
variable on every iteration. I shall often refer to input connectors 1 and 2 
as the initial and feedback connectors of the loop junction. 

5. Loop Output 

Loop output nodes are used in conjunction with loop junctions to 
precisely define what is to be considered the result of an iterative process. 
Proper usage of loop output nodes requires that their control input connector 
be attached to the control output connector of a loop junction. Some of the 
examples in the next section will serve to clarify the relationship between 
loop junctions and loop outputs. 

6. Input Terminals 

Input terminals are nodes with no inputs and precisely one output. 

7. Output Terminals 

Output terminals are nodes with no outputs and precisely one input. 
D. THE CONSTRUCTION OF PROGRAM GRAPHS 

This section sets forth the rules for constructing program graphs 
and provides a few examples of the use and abuse of these rules. 

A program graph is a finite set of input terminals, output terminals, 
and nodes interconnected by data links and control links according to the 
following rules: 
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1. The root of a data link must be attached to an input terminal 
or to a data output connector and its tip must be attached to 
an output terminal or to a data input connector. 

2. The root of a control link must be attached to a control output 
connector and its tip must be attached to a control input 
connector. 

3. Every input connector of a node must be attached to some link. 
Figures 2. 3, 2. 4, 2. 5, and 2. 6 are examples of program graphs. 

Each example is provided with an Algol-like description of the algorithm. 

Figure 2. 3 illustrates how functional composition is represented by 
the interconnection of data operators. Figure 2. 4 illustrates the use of 
loop junctions and loop outputs in a simple iterative process. The arrange- 
ment illustrated in the figure is used whenever an output value, e. g. "ans" 
is desired only upon completion of the iterative process. Quite often itera- 
tive processes are used which do not behave this way, but instead output 
values are produced on every iteration. A common example of this type of 
iteration is that of a program producing lines of output. Figure 2. 5 shows 
another example of this situation which is perhaps not as obvious as the 
•output feeder' case. The flow chart representation of this algorithm shows 
a single loop however, upon separating the data flow from the control flow 
in the program graph representation, two distinct loops arise: a counting 
loop (loop junction labelled _i) and a summation loop (loop junction labellet^) 
with the counting loop effectively controlling the iterations of the summation 
loop. It should be noted that this type of relationship between two or more 
loops often gives a clue to one of two forms of parallelism among sub-parts 
of the process: 
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Sqrt (Sin(X f 2) + cos ( I - tan (Y) / 2 ) ) 




Fig. 2, 3 Functional Composition in a Program Graph 
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t • t,(K); 
z-f 2 (t); 

vf 3 U); 

t»if£,U) th«n f 4 (v)«l»« f 5 (z); 
If /9 2 (t)th«n begin 
t-f 7 (t); 
gotol «nd 
on»» f 6 (t); 



ons 



Fig. 2.4 A Simple Iterative Process 
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1. Hori zontal parallelism meaning simultaneous operation of 
individual computations without imposing requirements on 
the sequence of using the results. 

2. Vertical parallelism meaning simultaneous computations 
with certain sequential constraints as to the use of the results 
of each computation. 

In the example of Figure 2. 5 horizontal parallelism will be possible 
given the extra knowledge that addition is commutative and associative, 
otherwise we have to be content with vertical parallelism, i. e. initiation 
of as many functions as possible, but adding them in the specified sequence. 

The final example of this section, shown in Figure 2. 6, illustrates 
one single loop (in the flowchart sense) with more than one loop junction. 
Recall that each loop junction represents one variable of the iterative pro- 
cess and a loop junction is required even for those quantities which are not 
changed within the loop because there is no permanent storage in a program 
graph, as is the case with the quantity denoted by A in Figure 2. 6. 
E. THE EXECUTION OF PROGRAM GRAPHS 

The transition tables for program graph nodes determine the dynamic 
behavior of a program graph by specifying whether or not a node should be 
activated, and if it is activated, whether or not certain data transformations 

should take place. 

Unless otherwise specified, all links are initially in the IDLE(O) 
status. Execution of a program graph begins when enough input terminals 
have been placed in ENABLED(l) status to produce an active configuration 
on some node of the graph. For simplicity, however, we usually assume 
that there is time, t Q , at which all input terminals are placed in ENABLED 
status simultaneously. 
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x«l; 
/: y * ovg( x + A/x) ; 

if x ^ y then begin 

* * y ; 

goto /end ; 
ons » y; 



Fig. 2. 6 A Single Loop with Multiple Loop Junctions 
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A simple example will serve to illustrate how the execution of a 
graph takes place. Figure 2. 7 shows a program graph at various stages 
of execution. In these figures, the number written to the right of each 
link is the link-status at the time of the snapshot; the data contents of the 
link is written to the left of the link as a functional expression. A '*' next 
to a node signifies that the node is in an active configuration. 

Figure 2. 7a shows the state of the graph shortly after time, t , with 
operators labelled f. and f-, active. In Figure 2. 7b operator f« has com- 
pleted its transition enabling f, to become active while f? 8 tiU nas not 
finished. The final snapshot Figure 2. 7d shows the state of the graph upon 
operator f / having completed its transition. Note that all links have been 
restored to the IDLE status. 

Figure Z. 8 shows a complex situation, arising due to the presence 
of a loop. Figure 2. 8a, b, c are snapshots during the execution of a non- 
final iteration showing the state of the graph before the activation of selector 
02 a.t two successive time intervals after the completion of the selector 
transition which enables the output link labelled '-'. Figure 2. 8d, e, and f 
is a similar sequence, but in this case P 2 nas enabled the output link labelled 
' + ' signalling the end of the iterative loop. These sequences serve to clarify 
the purpose of the link-status value blocked which only affects loop 
junctions and loop outputs. While the loop is in progress, the initial con- 
nector of the loop junction is in blocked status, effectively blocking any 
attempt to initiate a new loop before finishing the current one. In the mean- 
time the loop output blocks any signals to the outside world. When the loop 
junction receives an indication that the cycle has finished (DISABLED status 
of the feedback connector), it signals the loop output that it is alright to allow 
an output to be produced. Again, note in Figure 2. 8f that upon completion of 
the iterative process all link-status values have been restored to the IDLE 
status. 
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Fig. 2. 7 States During the Execution of a Cycle 
Free Program Graph 
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F. THE DETERMINISM OF PROGRAM GRAPHS 

The rules for interconnecting nodes set forth in Section D do not 
place any restriction on the topology of the resulting program graph. 
Furthermore, it has been specifically assumed that we have no knowledge 
of the time elapsed between the initiation and the completion of a transition. 
These two situations combined can result in the specification of a process 
whose behavior is unpredictable in the sense that two distinct executions of 
the process with the same set of data values supplied at the input terminals 
may produce a different set of results. 

The behavior of a program graph is determined by the link-status 
and the data contents of the links of the graph. We shall denote these two 
properties of a data link by an ordered pair (s, d) where £can take any of 
the link-atatus values -1, 0, 1, 2 and d is a functional expression, e.g. 
f (x, i 7 (y, z)) denoting the value of the data contents. In the case of a 
control link, data contents is not defined so that only the link-status value 

s will be used. 

If n is the number of links in a graph, then the state of the graph is 
an ordered n -tuple A = (a r a.,, ... a n ) where each state variable a. { is 
either an (s, d) pair or an £ depending on whether ai is associated with a 
data link or a control link. Two states A and B are equal if and only if for 

all 1< i< n. s = s L and d = d, . The state determines which nodes of 
— — a. b. a. d. 

1111 

the graph are in an active configuration. We make this explicit by 

associating with each node an n -tuple as follows: 

The ith element of the n-tuple for a node f is zero unless 
the link associated with the corresponding element of the 
state is attached to f. In this case the ith element is the 
number of the connector of f to which the link is attached. 
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For example if the third, fourth, and sixth links of the state vector are 
attached to the second, third, and first connectors of f, the n-tuple for f is 
(0, 0, 2, 3, 0, 1,0,... ). The n-tuple associated with a node f will be called 
the connectivity vector of f and is denoted by C*. 

A state A changes into a state A' upon completion of the transition 
of one of the active nodes of A. The components of the new state A' are 
determined by those of the old state A and the transition table for the node. 
If f is any node, the notation A 1 = A x C, is interpreted as follows: 

1. If the ith element of C, is zero then the ith element of A' is 
the same as the corresponding element of A. 

2. If elements of A corresponding to non-zero elements of C, 
form an active configuration of f, the corresponding elements 
of A* are obtained by using the applicable transition of f. 

3. Otherwise these elements are not changed and A* = A. 

We now introduce the concept of the possible "next" states A* of 
a state A by means of the relation Off . 

Definition 2. 1 A state A' follows a state A iff A' results from the 
completion of the transition of none, one, or more active nodes of A. If 
A 1 follows A we write AiR. A'. We say A' is a next state of A. 

Definition 2. 2 A final state of a program graph is a state in which 
no node is active. 

From the definition of 61 and final state it is clear that a state A 
is final if and only if K0t A' implies A = A*. 

During execution, a program graph passes successively from one 
state to one of its next states. 

Definition 2. 3 An execution sequence of a graph is a sequence of 
states A Q , A. . . . A, such that A. #A. . and A. ^ A. ,. 
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Definition 2.4 An execution sequence A 0> A 1 ... A R is terminal_ 
if A is a final state. If cr is an execution sequence, the length of a 

K 

denoted by !(ff) is the number of states in the sequence. 

For a given initial state, a program graph may exhibit several 
execution sequences depending on the relative speeds of the nodes. The 
problem of the speed-independence of the final state (when it exists) of a 
program graph with respect to an initial state A Q is crucial to the justifica- 
tion of the model. The only requirement that we place on the behavior of 
a program graph is that every node transition is an indivisible operation, 
i. e. , once a transition begins the indicated changes of status take place 
simultaneously. This assumption does not say that a node placed in 
active configuration performs the corresponding transition immediately. 
Quite to the contrary, we do not place any restrictions in the time interval 
elapsed from the time an active configuration occurs to the time a transition 
is actually performed. This of course raises, among others, the possibility 
of a node entering and leaving an active configuration without performing 

any transition. 

Theorem 2. 1 establishes a property of the ^ relation which, as 
we shall see, is sufficient to guarantee the uniqueness of the final state of 
a program graph for any assignment of elapsed times to the nodes of the 
graph. This property of the <# relation is closely connected to that existing 
among the states of semimodular asynchronous circuits as described by 

Muller and Bartky. 

Lemma 2. 1 Let A Q be a non -final state of a program graph P and 
let A, and A? be any two states of P such that Aj = A Q x C f , 

A, = A n x C, . Then, there exists a state A 3 such that A. <R> A 3 

2 ° *2 

0< i< 2. 
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Proof : From the definition of the ^ relation, if A Q = A^ = A 2 
then A Q satisfies the requirements for A~. Similarly if A Q ^ Aj = A., 
then A, ~ A, = A, satisfies the conditions of the lemma Therefore assume 
that A , A , and Ay are distinct. This means that there are at least two 
active nodes f. and f, in A fi . We claim that the state arising from the 
simultaneous completion of the transitions of f, and f, satisfies the conditions 
for A.,. 

First we note that the active configurations of program graph nodes 
as shown in Table 2. 1 place certain restrictions on the possible inter- 
connection of nodes which are simultaneously active. Specifically, we 
have the following: 

1. The status of an output connector is IDLE for any active 
configuration. 

2. The only input connector which can be in IDLE status when a 
node is active is the feedback connector of a loop junction. 

These two observations tell us that if two nodes are in an active 
configuration in the same state then either they do not have a common link 
or they have a common link which is attached to the feedback connector of 
a loop junction. 

If the nodes f. and f_ in Aq do not have a common link it is clear 
that the state A, resulting from the simultaneous completion of their 
transitions is identical to the states A, x C, and A ? x C, . 

Thus all it remains to show is that when £, or f ? or both are loop 
junctions sharing a link, the order in which these nodes complete their 
transitions does not matter. Figure 2. 9a and 2. 9b show the two possible 
connections that may exist between f, and f_ up to symmetry. In both of 
these cases an output of f, is attached to the feedback connector -of f ? and 
since f, is active this link must be in idle status. The only active 
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Fig. 2. 9 The Possible Configurations of Two Active Nodes 

Sharing a Link 
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configurations of loop junctions with a feedback link in idle status are, 
from Table 2. 1, 10 and -10 0. By a straightforward use of Table 2. 1 
it can now be checked that the value and status of all links attached to f. and 
f 2 are identical independently of the sequence in which their transitions are 
completed. 

Q. E. D. 
L emma 2. 2 Let Aq be a non -final state of a program graph P 

and let Aj = A fl x C f ' V A for l — i l k# Then there exists a 

i 
state A k+1 such that A. ^v A, ., 0< i < k. 

Proof: Since A i I A Q , A Q has at least k-active nodes f. , f_, . . . i. ■ 

From the proof of Lemma 2. 1, the completion of a transition of an active 

node cannot place any other active node in a non-active configuration. 

We claim that state resulting from the simultaneous transitions of f , . U, 

. . . f k satisfies the conditions of the state A, . . 

From Lemma 2. 1, there exists a state A such that A ft ^?A , A ^A , 

nm " nm n ™ nm 

and A <# A^ for all 1 < n, m< k and n i m. States A . and A. are 
m nm _ _ m im 

obtained from state A. by the completion of precisely one transition, 
consequently by Lemma 2. 1 we again conclude that there exists a state 

A nim BUCh that A ^ A «W K&Ki™ A ~& A • . A. <#A . A #A . , 

mm w mm n mm, m mm i mm, n. mm 

and A. m ^A nim for all 1< i <k, i t n, i * m, and n + m. By 

repeating this process, we must eventually reach a state A. , 

satisfying the conditions of the theorem. 

Q. E. D. 

The construction of Lemma 2. 2 is illustrated in Figure 2. 10 for 

the case k = 3. In the process of proving this lemma we also proved the 

following. 

Theorem 2. 1 Let Aq be a non-final state of a program graph P 
and let Aj, A 2> . . . A fc be states of P such that A Q <2#A., 1 < i < k. 
Then there exists a state A R+ l such that A. <@ A k+ l for 0< i< k. 
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Fig. 2.M> The Relation Among the 'Next' States of a State A Q 
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Theorem 2. 2 Let A Q be the initial state of a program graph. 

If there exists an execution sequence cr^ = Aq A^ . . . A k such 

that A, is a final state then A k is unique. 

Proof: To prove the theorem we will show that for any other 

execution sequence with the same initial state as 0^, e. g. O^ = AqBj. . . 

B , if B i A. then B is not a final state, 
m m k m 

The proof consists of constructing two new execution sequences 
<j\ and cr' such that t(v z )< Ko^l and every state in o' 2 is also a state of 

a j. Since o 7 is a finite sequence, successive applications of the construe- 

i i ii H r r ... r rx a 1 " a 

tion yields sequences a., (J?, a . , O ^, . . . CTj . O^ with O^ = r> m ^ . . . J\^ , 

(;_ = B , i.e. A, is a next state of B . 

2ml m 

To construct the execution sequences (7. and O^ we proceed as 
follows: 

Let A. be the last state in 0\ which also appears in a 7 . There 

J 1 ■ c 

is at least one such common state, namely Aq. 



and 



A. Aa. u , in a, 



A. &B., . in a? 



From Theorem 2. 1, there exists a state q ouch that A. +1 ^Jq and B r+1 d£q. 
The state q can be either in sequence <7~ or in sequence (^ or in neither 
sequence. Specifically, we must consider the following three cases, 
(Figure 2. 11): 

1. q = B for some n 1 < n< m 
n n — 

2. q = A for some n j + 1< n< k 



n 



3. q i A , a £ B for any n. 
n n 



■ 35. 




Cos* 3 



Fig. 2. 11 The Three Cases in the Proof of Theorem 2. 2 
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Case 1 

Setff, l sA j+lV" ,A k 1(ff l ,<i|ff l ) 

^ = A j+ l B n B n + l'" B m i<*i><*<" 2 > 

This case cannot occur indefinitely for if it did we could find two 

sequences (xf, (T? 8UCn tnat 

a l A k 

*2 = A k"- B m 
which contradicts the assumption that A fc is a final state. 

Case 2 

Set a\ = B. + 1 A n ... A k itff'pi^CTj) 

ff 2 = B j+ l B i + 2'-- B m i(^)<i(cr 2 ) 

Case 3 

By repeated application of Theorem 2. 1 there must exist states 
C , C ? , . . . such that 

q^C 1 <€C 2 ... &\ 
where C. is a state such that A ; + 2 C i' ** ^1 

C- is a state such that A. + 3 ^C 2> Cj * C 2 etc. This must 
stop at A, because it is terminal. 
Thus we set 

a \ =B j+l qC l C 2'-- \ 

V B j+ i B H2- B m i<a 2 Xi«r 2 > 

Since Case 1 must eventually produce sequences or',. O^ 8Ucn that either 
Case 2 or Case 3 applies, and in both cases t{v' 2 )< ^(0^ we conclude 
that eventually sequence a 2 will be B m alone. 

Q. E. D. 
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Thcorem 2. 3 Let A Q be the initial state of a program graph. If 
there exists an execution sequence O. = Aq A. Ay . . . A, such that 
A, is a final state, then every sequence with initial state Aq is 
terminal on A, . 

Proof: All we need to show is that every execution sequence is 
terminal and by Theorem 2. 2 it will follow that the final state is A k> 
Assume that there exists a non-terminal execution sequence 

2 12 n 

Then we construct two new execution sequences cr. and 0"~ such that 

2{a\ ) <i(o\) and a\ and a' have the same initial state. Successive appli- 

cations of the construction yields sequences a, = A, and Q- = A. . . . A . . . , 

contradicting the assumption that A, is a final state. 

To construct the execution sequences cr. and cr, we proceed in a 
similar way as in the proof of Theorem 2. 2. 

Let A. be the last state common to sequences cr. and cr,. 

A j^ A j+l in0 "l 

A. $A' . in cr, 
J J+1 2 

By Theorem 2. 1 there exists state q such that A... ^q and A\ . #?q 
consider the three cases (Figure 2. 12): 

1. q = A for some n, j+l< n 



2. q = A for some n, j+l< n< k 

^ n — 

3. q £ A q £ A 1 for any n 



n * n 
Case 1 



Set or; = A. + 1 A. + 2 . . . A^ A(a\)< 1(0^) 



2 j+1 n n+1 



A., , £ A 1 since A. is the last common state in both sequences. 
j+1 n J 
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Fig. 2. 12 The Three Cases in the Proof of Theorem 2. 3 



# 
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Case 2 

Set a\ = A' x A £ ... A k Ha^)^!^) 

1 - A 1 A } 

2 j+1 j+2 

A*. , ^ A, since A. is the last common state in both sequences. 

j+1 i j 

Case 3 



By Theorem 2. 1, there exists states C , C~» . . . such that 
q $C l & Cy. . . . Therefore, set: 

a 'l = A j+1 A j+2 ••' A k i K )<i(ff l» 

a 2 = A j+l qC l C 2 ■•• 
To complete the proof, we show that the condition i(o\) = 1(<J,) in Case 2 
cannot occur indefinitely. From the construction of the sequences 0\ and 
a' ? . ii i(v\) = i(O'j) indefinitely, then there exists a state A. . in o\, and 
states A 1 .,,, a!.-,... in o, such that A.-wA;.,, A. y& A\ ' a\,.0vA. , 

j+i j+2' 2 j^ j+r j j+i j+i j+i 

A*. , -, & A. ,,,... However, this implies that there are an infinite number 

J+2 j+1 

of active nodes in state A. which is impossible. Therefore, either there 

J 

is a state A*. , in a- such that A 1 .. &A., , s > 1, or Cases 1 or 3 apply. 
j+r 2 j+r j+s 

Whichever alternative occurs, i (al) < i(<r,). Therefore, or, must be 
terminal in A, . 

Q. E. D. 



III. ANALYSIS OF PROGRAM GRAPHS 

A. INTRODUCTION 

The results of Chapter II tell us that every program graph represents 
a deterministic process. It is possible, however, to construct program 
graphs such that for some or all sets of input values no complete set of 
output values is ever produced, even when all execution sequences are 
terminal. If we view a useful computational process as a transformation 
of a set of input values into a set of output values, then not every program 
graph represents a useful computation. 

The failure of a program graph to produce output values may be 
caused either by a never-ending cycle or by entering a final state pre- 
maturely. It is this second condition, which we call a hang -up state , that 
we are interested in because it is peculiar to program graphs, and because 
a study of the structure of graphs where it occurs provides insight into the pro- 
perties of the model. 

The occurrence of a hang -up state during an execution sequence is 
due to structural anomalies of the graph. These anomalies can arise from 
obvious misuse of a node for a purpose for which it was not intended, e. g. 
connecting a loop output control connector to a node other than a loop junction. 
Less obvious and more interesting structural anomalies arise in connec- 
tion with communicating cycles. Section B introduces terminology and 
notation. In Section C we present several examples illustrating the proper 
use and the misuse of the various node types. Section D considers hang-up 
states in cycle free graphs. Finally Section E studies hang-up states in 
cyclic graphs. 

-40- 
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B. NOTATION AND TERMINOLOGY 

1 . Notation 

In this and subsequent chapters we will use the following notation 
when referring to nodes of program graphs: 

Input terminals will be denoted by the letter o_ . 

Out put terminals will be denoted by the letter xo. 

D ata operators will be denoted by the letter _f. 

Selectors will be denoted by the letter J3. The output connectors 
of a selector will be distinguished by writing |3 or (3 . 

Junctions will be denoted by the letter j^. 

Loop junctions will be denoted by the letter £. 

Loop outputs will be denoted by the letter h. 

Links will be denoted by the letter jL 

Each of the above symbols will be used with a number subscripts 
when it is necessary to distinguish among two or more instances of a type, 
e. g. f,, f 2> 0,, P,. The letter a will be used to denote a node without 
specification of its type. 

2. Paths, Cycles, and Connectivity 

The following concepts and terms associated with directed graphs 
have been adapted from Busacker and Saaty. 

A finite sequence of links i., l^, . . .i^ is said to constitute a path 
of length k in a program graph P if there are nodes a.^ , a 2 » • • • a^ j in P 
such that i. is a link from an output connector of a- to an input connector 
of a. , ,. The path is said to pass through the nodes a., a,, . . . ^t r ^ e 
nodes a, and a, . are said to be the initial and final nodes of the path, 
respectively, and it is said that there is a path from aj to a k+1 » If 
a. = a,,, the path is said to be a cycle. If all the k+1 nodes are distinct, 
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the path is called a p roper path. If a t = a k+1> but otherwise all nodes are 

distinct, the path is said to be a proper cycle. Clearly, all links of a 

proper path or cycle ;< re distinct. If all the k links are data links the 

path is called a data path . Similarly, a control path consists solely of 

control links. A program graph is said to be c yclic if it contains at least 

one cycle and cycle free otherwise. 

Given two nodes a. and a. of a cycle free program graph P, it is 

said that a. is an ancestor of a., or alternatively that a. is a descendant of 
j j j 

a., if there exists a proper path from a i to a.. If a^ is an ancestor 
(descendant) of a. and there is a path of length 1 from a.(a. ) to a.fa^ it is 
said that a. is a direct ancestor (descendant) of a.. 

A subgraph P' of a graph P is a subset of the set of nodes of P 
together with all the links connected to these nodes. If for every pair of 
distinct nodes a. and a. of P' there is a path from aj to a. as well as one 
from a. to a., it is said that the subgraph is strongly connected. If, in 
addition, this condition is not satisfied for any pair of nodes aj and a^ when 
a. but not a, is contained in P ( , then it is said that P' is a maximal 
strongly connected subgraph (abbreviated mscs). 

Two subgraphs P f and P" of a program graph P are said to be 
disjoint if they do not share a common node. 

3. Normal Sequences and Hang -up States 

The last two definitions in this section are concerned with certain 
properties of the initial and final state of execution sequences of a program 
graph. In order to study the behavior of program graphs it is convenient 
to concentrate our attention to a limited, yet useful, class of execution 
sequences by normalizing the initial state of these sequences as follows: 
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Dcfini tion 3. 1 A normal execution sequence of a program graph 
is an execution sequence with an initial state in which all links of the graph 
are in idle status except for those links attached to the input terminals. 
Henceforth, execution sequence will be used interchangeably with normal 
execution sequence. Furthermore, unless otherwise specified we will 
assume that the links attached to the input terminals are in enabled status 
in the initial state. 

The final state of a terminal execution sequence will be called a 
hang -up state or a normal state according to whether or not it satisfies the 
following: 

Definition 3. 2 A state of a program graph is a hang -up state if 

1. No node is in an active configuration. 

2. At least one link is not in idle status. 
C. EXAMPLES OF PROGRAM GRAPHS 

1. Properties of Transition Tables 

In this section we will consider in detail several examples of 
program graphs. We do this with a dual purpose. First, we want to 
acquaint the reader as much as possible with the manner of execution of 
a program graph. Second, we want to provide a better understanding of 
the properties of each type of node and how they should and should not be 
used. Concurrently we will indicate some of the reasons for the choices 
made in the specification of the transition tables. 

During execution, the state of a graph changes as a result of the 
transitions specified by the active configurations of each type of node. 
The active configurations of a node are determined only by the status of 
the input and output connectors of the node. Upon completion of any transi- 
tion these statuses are always changed. For some transitions the value of 
the output connectors may also be changed. 
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An examination of Table 2. 1 reveals the following facts: 

1. In all active configurations of every node type except loop 
junctions the status of every input connector is never IDLE(O). 

2. In all active configurations the status of every output connector 
is always IDLE. 

3. Upon completion of each transition, except for loop outputs, the 
status of every output connector is always non-IDLE. 

4. Upon completion of each transition, except for loop junctions, 
the status of every input connector is always IDLE. 

5. Selectors are the only nodes which place one of their output 
connectors in disahled status when none of their inputs are 
DISABLED. * 

6. The function and predicate associated with operators and selectors 
respectively are applied to the input values only if no input is 
DISABLED. 

7. The application of the function associated with a data operator 

to obtain a new value for an output link always results in placing 

the link in ENABLED status. 

Items 1 and 3 suggest viewing the execution of a graph as effecting 
i 
the flow of status and data information from one node to another in the 

i 

direction indicated by the oriented links. The IDLE status signifies either 

1 

ftiat no activity has taken place on a link or that previous activity on a link 
has been properly accounted for. As a rule, activity must occur at each 
input to a node before the node can perform any action. The only exception 
to this rule is the loop junction which under some circumstances, only 
requires one of its input connectors to be in non-IDLE status to become 
active. Effectively this means that each node waits to receive information 
from each of its ancestors before it takes any action. 
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Items 2, 3, and 4 point out that new activation of a node cannot 
occur until the information transmitted to the immediate descendants of 
the node has been used by these descendants. This observation together 
with items 6 and 7 imply that, as a rule, both the status and data of a link 
attached to an input connector of a node are effective for precisely one 
activation of the node. The only exception to this rule can be found in loop 
junctions and loop outputs both of which have provisions for 'remembering' 
status and data information. This property of loop junctions and outputs 
appears to be needed in order to obtain a deterministic model in the 
presence of cycles. 

Finally, items 5 and 6 point out the unigue function of selectors as 
the arbiters which determine the functions and predicates that should be 
applied during the course of an execution sequence. Note that application 
of a function or predicate requires that the associated node be active, 
however the converse is not true. In fact, most of the active configurations 
shown in Table 2. 1 do not require application of a function, predicate, or 
effecting a data transmission operation. Instead, their only purpose is to 
propagate through the graph the necessary status information. The enable 
and disable statuses get their names from the effect that a link exhibiting 
these statuses have on the data transformation and transmission action of the 
nodes to which the link is attached. 

2. The Use of Selectors and Junctions 

Selectors and junctions have complementary functions. If we view 
the action of a selector as choosing between two alternative sequences of 
data transformations, then the purpose of a junction is to transmit the 
result of whichever sequence was chosen to succeeding computations. 
Figure 3. la illustrates the simplest form that this relationship between 
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(o) 



(b) 



Fig. 3. 1 Use of Selectors and Junctions 





(o) 



(b) 



Fig. 3.2 Junctions Creating Hang-Up States 
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selectors and junctions can take. Clearly one selector can be used to 
choose one alternative from any number of pairs of sequences. Further- 
more, several selectors may have to be invoked, either sequentially or 
in parallel, when more than two alternatives exist or when complex 
decision rules are needed. Figure 3. lb illustrates some of these points. 

Figure 3. 2a illustrates a typical misuse of a junction. In this 
graph, data junction j will never become active, since Table 2. 1 requires 
that one or the other (or both) of its inputs be in the disabled status for 
any active configuration. Note that if the junction transition table did not 
have this characteristic, then the output of junction jj would depend on the 
relative speed of operators f, and i^. Figure 3. 2b shows another example 
of this situation. In this case, junction jj is placed in a hang -up configura- 
tion if during an execution sequence the parallel selectors (3j and £-, enable 
their respective ' + ' connectors. Compare this with the arrangement of 
selectors (3. and p~ in Figure 3. lb where no hang-up configuration arises. 

The need for this type of behavior in junctions imply that in order to 
guarantee determinism we have to: 

1. have three distinct link status values. 

2. propagate a disable status throughout the graph. 

3. The Use of Loop Junctions and Loop Outputs 

Now let us turn our attention to the use of loop junctions and loop 
outputs. Loop junctions allow us to construct cycles in a program graph 
without necessarily introducing hang-up states. To see the necessity of 
loop junctions, consider the graph in Figure 3.7. If all links are initially 
in idle status, operators f 2 and f, will never become active because the 
idle output status of each prevents activation of the other. Clearly what 
is needed is a type of node which does not require each of its inputs to be 
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in non-idle status before it can become active. We have already seen in 
the case of junctions that if the inputs of such a node were symmetric, 
non -deterministic behavior would arise even in the absence of cycles. It 
is not hard to convince ourselves that in order to have deterministic 
behavior given an n input node with an asymmetric transition table, the 
inputs must be arranged in a priority scheme. This priority must 
effectively dictate that an input cannot place the node in an active configura- 
tion unless the node had been previously activated by an input with a higher 
priority. For, unless this condition is satisfied the sequences of values at 
the outputs of the node would depend on the sequence of arrival of values at 
each of the inputs. 

In order to implement this priority in a transition table it is neces- 
sary to introduce a fourth link status whose function is to remember the 
history of the activations of the node until such a time as this history 
becomes irrelevant. The link status blocked( 2) serves this purpose in a 
program graph. Examination of the transition table for loop junctions reveals 
that the high priority input is the one labelled 1_ which we call the initial 
input. The low priority input, labelled 2 will be called the feedback input . 
The behavior of a loop junction can be described as follows: The node becomes 
active as soon as the initial input becomes enabled or disabled independently 
of what the status of the feedback input is. The next active configuration 
of the node must be one in which the feedback input is enabled or disabled 
while the initial input is blocked. 

Now we have to make a choice as to when to forget the history of 
activations of a loop junction. Since we want to allow an arbitrary number 
of repetitions of a cycle, the cue for this transition must come from the 
feedback input to the loop junction. The only two information 
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Fig. 3. 3 Single and Parallel Cycles 
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stutuses possible on a link attached to the feedback input are enabled and 
disabled. The obvious choice is the disabled status. 

Figure 3. 3a shows a simple example of a cyclic graph. Loop 
junction g, forms a cycle together with operators fj and f 2> and selector 
P . The cycle is initiated by enabling the input terminal a. Each time Pj 
is enabled, f 2 .g 2 ' f i' and Pi are reactivated. Note that since enabling 
p + implies disabling p", operator f,, which is not a part of the cycle, will 
be activated on every iteration as well. This secondary effect may or may 
not be desirable. Figure 3. 3b illustrates a cyclic graph with two parallel 
cycles. The cycle on the left, nodes g 1 and f , receives inputs from the 
cycle on the right. Both cycles repeat as long as pj is enabled. When Pj 
is disabled, both cycles terminate. Operator f 3 is in neither cycle, yet it 
becomes active during each iteration, in this case performing a useful 
function. In the example of Figure 3. 3a, the repeated activation of f 3 causes 
a sequence of disable statuses to appear at the output terminal to. Upon 
termination of the cycle, the output terminal is enabled. In this instance, 
it is desirable to prevent the activation of f 3 while the cycle is in progress. 
In fact, if it is not possible to exert this type of control, we cannot construct 
graphs with nested cycles which are free of hang-up states. This difficulty 
is illustrated in Figure 3.4a where after four repetitions of the 'inner 1 cycle, 
formed by nodes g 2> f 2> P,, and f_, every node is unable to enter an active 
configuration because the output of p^ , f 4> f 5 are in non-idle status and 
the initial input of g, is in idle status. 

Loop output nodes have been introduced to avoid such situations. 
Figure 3. 4b shows the proper use of loop outputs to avoid hang-up states in 
the example of Figure 3. 4a. A loop output should be connected only to a 
loop junction. The proper form of this connection is illustrated in Figure 3. 5. 
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Fig. 3.4 Nested Cycles with and without Loop Output Nodes 
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Dy examining Table 2. 1 we can verify that in this arrangement the output 
link of a loop output becomes non-idle only when the feedback input of the 
loop junction becomes disabled (provided the initial input had been enabled 
or disabled), i. e. when the cycle formed by the loop junction terminates. 
D. ANALYSIS OF CYCLE FREE GRAPHS 

1. The Role of Cycle Free Graphs 

In this section we study certain properties of cycle free program 
graphs. The simplicity of this class of graphs relative to cyclic graphs 
makes them a natural starting point in the analysis of program graphs. 
Furthermore, some of the questions about cyclic graphs raised in the next 
section can be satisfactorily resolved by reducing them to similar questions 
about cycle free graphs. 

2. Properties of Execution Sequences 

Intuitively we expect each execution sequence of a cycle free graph 
to be terminal. In fact, at this point such a statement should not take us 
by surprise. However, the method we have chosen to specify the behavior 
of each node, i. e. the transition table, does not make this property obvious 
or even necessary. The following theorem and its corollaries are a justi- 
fication for the choice of directed graphs for our representation. 

Theorem 3. 1 Every execution sequence of a cycle free program 

graph is a subsequence of a terminal sequence. 

Proof : Assume that the theorem is false. Then we can find an 
execution sequence which never terminates. Since the number of active 
configurations in the transition table of each node is finite, it follows that 
there is at least one node which is placed in the same active configuration 
an infinite number of times. An examination of Table 2. 1 indicates that 
after completion of the transition of most active configurations of a node, 
a new active configuration can occur only if the status of the input 
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conncctors of the node are changed by its direct ancestors. The only 
exceptions to this rule are the four active configurations of a loop 
junction: 1_1 0. 1-1 ,_-l_j_0_0. and-WjD^O. For these configurations 
two transitions may occur while the direct ancestors of the loop junction 
are necessarily non-active. Thus, if a node is active an arbitrary num- 
ber of times, the same is true of at least one of its direct ancestors. 
Since the graph is cycle free, by repeatedly applying this reasoning it 
must be that the initial terminal must be active an infinite number of times 
against the definition of an execution sequence. This shows that every 
node must be active a finite number of times. Therefore each execution 
sequence must eventually reach a final state and is a subsequence of a 

terminal sequence. 

Q. E. D. 

Corollary 3. 1 A program graph with an infinite execution 

sequence must be cyclic. 

Corollary 3.2 If a. and a. are two nodes of a cycle free program graph 
and there is a proper path from a i to ^ which does not pass through any 
loop junction (except for a.), then a. can become active only after a. has 
completed a transition. 

Proof: In order for a. to become active, all of its inputs must be 

1 J 

non-idle. Since initially all links are in idle status, this change can take 
place only by completing a transition of all its immediate ancestors. By 
repeating this process, the immediate ancestors of the immediate ancestors, 
. . . etc. must also complete a transition. But a. is an ancestor of a~ 
Thus eventually a. must be encountered in the chain of direct ancestors 
which must complete transitions before a. can become active. 

Q. E. D. 
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Thcorem 3. 1 applies to an arbitrary cycle free graph. However, 
from a behavioral point of view, loop junctions and loop outputs do not 
perform any useful function in a cycle free graph while unnecessarily com- 
plicating the analysis. This motivates the following definition: 

Definition 3. 1 A simple cycle free program graph is a cycle free 
program graph which does not contain any loop junctions or loop outputs. 

In Section C it is mentioned that the effect of most active configura- 
tions is to propagate the necessary status information throughout the graph 
even if no functional application (and presumably useful computations) take 
place. The following theorem shows that this is a necessary condition for 
the absence of hang -up states. 

Theorem 3. 2 The final state of a terminal execution sequence of 

a simple cycle free graph is not a hang-up state iff every node of 

the graph enters an active configuration exactly once during the 

execution sequence. 

Proof : Assume the final state is not a hang -up state. Then every 
link is in idle status in the final state. Since initially all links attached to 
input terminals are placed in non-idle status, it follows that every direct 
descendant of an input terminal must have been in an active configuration. 
But every transition of a node appearing in the graph, i. e. operator, selector, 
and junction, places each of its outputs in non -idle status. Therefore the 
direct descendants of these nodes must also have been in an active con- 
figuration. This shows that every node becomes active at least once. 
However, by Table 2. 1, each active configuration requires all input 
connectors in non -idle status, whereupon the completion of each transition 
reverts the status back to idle. Since there are no cycles, the Btatus 
must remain idle thereafter which shows that each node becomes active 
at most once. 

Q. E. D. 
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Fig. 3. 5 The Proper Way of Connecting Loop Junctions 

and Loop Outputs 





(o) 



(b) 



Fig. 3. 6 Initial States of Program Graphs that do not 

Satisfy Theorem 3. 2 

°2 




Fig. 3.7 A Cycle that does not Pass Through a Loop Junction 
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Corollary 3. 3 A node of a simple cycle free graph becomes 
active at most once during an execution sequence. 

The simple characterization of hang -up states of Theorem 3. 2 
is not possible if we neither have a normal execution sequence nor are 
loop junctions forbidden from the cycle free graph. Figure 3. 6a shows a 
program graph with an initial state such that the final state of every 
execution sequence is not a hang-up state, yet junction jj is never in an 
active configuration. In the program graph shown in Figure 3. 6b, all 
nodes become active during each normal execution sequence, yet the 
final state is a hang -up state. 

The following theorem shows that junctions constitute the source 
of all hang -up states in simple cycle free graphs. 

Theorem 3. 3 A node of a simple cycle free graph does not enter 
an active configuration during a terminal execution sequence iff 
the node is, or has as an ancestor, a junction with at least two 
input connectors in enabled status upon reaching the final state. 
Proof: If a node is a junction and during the execution sequence 
two of its inputs become enabled, then by the transition table for junctions, 
it will never become active. By corollary 3. 2, any descendant of this 
junction will never become active either. 

Now assume that no two inputs of a junction are enabled during 
the execution sequence and that some other node does not become active. 
By the transition table of operators, selectors, and junctions this can 
only occur if a link remains in idle status throughout the execution 
sequence. This in turn implies that one or more of the input links of 
the node to which that link is attached must have remained in idle status 
also. By repeatedly applying this reasoning we must eventually reach 
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a link attached to an input terminal and this link must have been idle. But 
this contradicts the definition of an execution sequence. Therefore every 
node must have been active during the execution sequence. 

Q. E. D. 

Theorem 3.4 A simple cycle free program graph has a hang -up 
state iff two or more input links of a junction are placed in 
enabled status. 
Proof: Immediate from Theorem 3.2, Corollary, 3. 3, and 

Theorem 3. 3. 

Q. E. D. 

It is clear that the hang -up states of simple cycle free graphs 
arise only as a result of improper specification of the relationship between 
junctions and selectors. 

3. The Enabling Function 

The foregoing results suggest that it is desirable to have an easy 
way of ascertaining whether or not two links can be placed in enabled status 
during an execution sequence. To this end we associate with each link of 
a simple cycle free graph a boolean function, called the enabling function, 
with the property that the link cannot be enabled during an execution if its 
enabling function has the value false . The enabling function associated with 
a link 1. will be denoted by E. . If E, and E ? are enabling functions then 
the union (or) is denoted by E 1 V E 2 and the intersection (and) is denoted 
by E A E ? . If B is a boolean variable, then~B" denotes its complement. 

To obtain the enabling functions associated with the links of a graph 
first assign a boolean variable B. to each selector P i , The enabling 
Ainction of a link I is obtained by recursively applying the following rules: 



we 



* Throughout this discussion we assume that each selector in a graph has 
a label distinct from every other selector label. 
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1. If £ is the output link of an initial terminal, assign to it the 

identity element ( true) . 

2. If £. is an output link of an n-ary operator, assign to it the 

function E, A E..A. . . AE , where E. is the enabling function 
Id n l 

associated with the i— input link. 

3. If I is the output link of an n-ary junction, assign to it the 

function E, V E,V. . . VE . 
1 2 n 

4. If / is the '+' output link of n-ary selector 0., assign to it 

the function B. A E, A E,A. . . AE . 
x 1 2 n 

5. If 1 is the '-' output link of an n-ary selector 0., assign to it 

the function RaE.aE-A. .. AE . 
l 1 2 n 

Clearly, the enabling function associated with a link involves only 
the variables B., their complement, and the identity element. In rules 
4 and 5 we have effectively adopted the convention that a boolean variable 
B. is true if the '+' output of the corresponding selector is enabled. We 
now define the relationship between the values of the B. and an execution 
sequence. Let (3, , 2> . . . be the selectors of a graph P, and let 
B = (b. , b 7 , . . . b ) be an n-tuple where b., 1 < i < n is either true or false. 
An execution sequence of P during which 0. is enabled only if b. = true 
is said to match the n-tuple B. Note that this definition does not require 
p. to be active during the execution sequence. If I . is a link of P, E. (B) 
denotes the value of the enabling function of i . when b. is substituted for 



B. in E.. 
l i 



Theorem 3. 5 Let P, 0., B., B, i., and E. be as above. If 
r i i l l 

E.(B) = false then i. cannot be enabled during any execution 
sequence of P which matches B. 
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l»ro»f: In the lransitk»n tables for «>perators, selector, and 
junction in Table 2. 1 nolC tl',.1 Ihe ^sif-nment enabled == true, 
<Hs.,.>led - false is consistent wit., rules 2. *.4. and 5. The transition 
labU .,. ,,-e not complete in the Bon.e thai junctions do not have an active 
conjuration 1 1 0. However every active configuration that can disable 
a „ output link of a junction is included in rule 2 and vice versa. Thus, the 
mil „ thai can be said is that a link cannot be enabled when its enabling 
function is false. q e ^ 

From 'theorems 3.4 and 3. 5 it follows that a simple cycle free 
,. r;il ,|, doe* not have hang-up .dates if for each pair of links |. and I. 
.,.,. i. an d I. are inputs of the same junction, Ej/nE^ S false. 



win 



!•',. ANALYSIS OF CYCLIC GRAPHS 

I. (!y«lr Decomposition 

In this section we undertake the study of cyclic graphs from the 
point of view of relating the cyclic structure of the graph to its behavior. 
The main results are that 

1. for a large class of cyclic graphs necessary and sufficient 
conditions for the absence of hang-up states can be obtained 
based on properties of strongly-connected subgraphs, and 

2. certain relations between cycles of a graph either introduce 
hang-up states or can be replaced, by cycle free graphs. 

The basis for studying relations among cycles of a graph Pisa 

decomposition of the graph into certain strongly -connected subgraphs 

K..K,, . . .K . The decomposition is unique and has the property that for 

any two strongly -connected subgraphs K. and K., either* K.c K., K.c K^, 

orK.HKjO. Thus the K. are partially ordered under the relation of 
i J * 

proper set inclusion. 

The decomposition of a graph P into its strongly-connected sub- 
graphs K. , K ? , . . . K is accomplished by the iterative application of a 
procedure which at each step of the iteration breaks certain cycles of P. 
If P r is the graph after the r th iteration (P = P°), then each of the K. is 
a maximal strongly-connected subgraph (mscs) of some P , <_i < r. 
The choice of which cycles are broken at each step is based on the remarks 
of section C that in order for a cycle of a program graph to be effective 
it has to pass through a loop junction. This motivates the following 
definition: 



A subgraph K. is contained in a subgraph K 2 if every node of K. is 
;ilsn t\ node o'T Ki, We write K1CK2 to denote inclusion and 
Ki C K7 to denote proper inclusion. The notation Ki fl K2 denotes the 
subgraph consisting of the nodes contained in both K\ and K>. If K j 
and K^ are disjoint we write KjH K£ = 0. 
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Oefini tiun 3. 2 Let K. be a strongly -connected subgraph of a 
program graph P. The G-set of K- is the set of loop junctions of P such 
(hat gc K. and the direct ancestor of the input connector of g is not in K.. 

The G-set of K. will be denoted by G^ 

In Figure 3.8, the G-set of mscs Kj consists of gj and g 2 . Now 

we show that certain hang-up states of a graph can be directly related to 
the G-sets of its strongly-connected subgraphs. First we need the 

following two lemmas: 

Lemma 3. L Let a. and a. be two nodes of a program graph P. 
" If there is a path from a. to a. and a becomes active during an 
execution sequence of P, then a i must have been active during 

th.it sequence. 

Proof: The proof is entirely analogous to Corollary 3. 2. 

Lemma 3. 2 If during a terminal execution sequence of a cyclic 

graph some node a does not enter an active configuration, then 

the final state is a hang -up state. 

Proof: Assume the lemma is false. Then every link is in idle 
status in the final state. Using the transition tables and modifying the 
argument of Theorem 3. 2 to take loop outputs into consideration it follows 
that every node must have been active at least once. Loop outputs deserve 
special attention because for some of their active configurations the status 
of the output link remains idle after the transition. However, these transi- 
tions leave an input link enabled or disabled; the only way that this link can 
become idle is if the active configuration enabling or disabling the output 
link occurs. Thus, if the final state is not a hang-up state all nodes have 
been active which contradicts the assumption. 

Q. E. D. 
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I'licorcm 3. (> Let K be a st rongly -connected subgraph of a 
program graph P. If the G-set of K is empty then P has a hang- 
up state. 

Proof: Since input terminals do not have any input connectors, 
no cycle can pass through them. For any node of P, there is a path from 
at least one input terminal to the node. Therefore, K has a node with a 
direct ancestor not contained in K. Let a be such a node. Since K is 

strongly -connected, there is a cycle I , f ^ 8Ucn tnat ' j ant * '^ are 

respectively an output link and an input link of a. If a is a loop junction, 
t, must be attached to its initial input for, otherwise the G-set of K 
would not oe empty. Thus, for any a, I, must become enabled before £ ^ 
does and by lemma 3. 1, a can never become active. By lemma 3. 2, it 
follows that P has a hang -up state. 

Q. E. D. 
If K . K ? , . . . K are the maximal strongly -connected subgraphs of 
P with non-empty G-sets G. , G^, . . . G , let P be the graph obtained from 
P by disconnecting all links attached to the feedback connectors of each 
loop junction g e G. , 1 < i < n. We say that P is derived from P. 

Theorem 3. 7 Let P be a cyclic graph and P its derived graph. 
Then 

1 . P is unique. 

2. P is cycle free or every mscs of P' is properly contained 
within precisely one mscs of P. 

Proof: That P is unique follows directly from the fact that a 
directed graph can be uniquely decomposed into its maximal Btrongly- 
connected subgraphs. 



h <- 



To show part 2, wo nolo that P l must necessarily have fewer 
rv I.-b than P since every proper cycle of P which passes through 

., ' G I < i < n Hoes not exist in P 1 . Thus, P 1 may he cycle free. 
^ i' — — j 

Alternatively, if P l is not cycle free, every proper cycle of P is also 

a cycle of P and therefore every mscs of P l is contained in one mscs 

of P. The inclusion is proper hecause at least every ge G { . 1 <i <" 

t o l 
is not contained in any mscs ol I ■ 



Q. E. D. 



Given a cyclic graph P, we can obtain a sequence of graphs 
P rr P° P l . . . P" such that P'" 1 l is derived from P 1 . Since there are a 
finite number of proper cycles in P and each step of derivation destroys 
one or more cycles, P" is either cycle free or it has an mscs with an 
empty G-set. If P n is cycle free it is said that P is L yc^^onsi8tent. 
The process of obtaining the sequence pV. . . P n will be called cycle 
dccom£o_sition. If P is cyclic consistent, P" is the cjcleji^jragh, 
generated by P. The mscs's of the graphs obtained during the cycle 
decomposition of P can be arranged in a tree structure. The root of the 
tree is labelled P and every other vertex of the tree is labelled with the 
name of one mscs in such a way that there is a branch joining vertex K. 
to vertex K. iff K.C K. . The tree obtained in this manner will be called 

J J 

the cyc le structure of P. A node a is said to belong to an mscs K of 
the cycle structure iff K is the smallest mscs containing a. Figure 3.8 
illustrates the application of the cycle decomposition procedure. The 
sequence P = pVp 2 appears in Figures 3.8a,b, and c respectively. 
The cycle structure is shown in Figure 3. 8c. Node f-, belongs to K3, 
while node f, belongs to K } . 
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2. Simple Cycli c Graphs 

The concept of cyclic consistent graphs suggests that we restrict 
our attention to the study of cyclic graphs which meet certain minimal 
structural conditions in the formation of their cycles. In Section D we 
defined simple cycle free graphs by disallowing the use of loop junctions 
and loop outputs. Here we define r umpl e graphs (scg) by only allowing 
'proper' use of loop junctions and loop outputs in cyclic graphs. Simple 
graphs include simple cycle free graphs as a special case. 

Definiti on 3. 3 A graph P is simple iff 

1. P is cyclic consistent. 

2. Every loop junction of P is in the G-set of some mscs of 
the cycle structure of P. 

3. Every loop output of P is properly connected to a loop junction. 
From Theorem 3. 2, we know that if all the paths from each ancestor 

of a node to the node pass only through operators, selectors, and junctions, 
then, in the absence of hang -up states. the node becomes active iff its 
ancestors do. This suggests the following definition associating the links 
of the graphs with the mscs of the cycle structure: 

Definition 3. 4 A link I belo ngs to an mscs K if there is a proper 
path ! j!-. . . !.* passing through nodes a 1( a 2> .. aj^a^^^ j such that 

1. a., 1 < i < k+ 1 is neither a loop junction or a loop output. 

2. a. is a loop junction contained in the G-set of K, or 

a is a loop output having as direct ancestor a loop junction 

whose initial input belongs to K. 
A link may belong to zero, one, or more mscs's. For our purposes, 
we will consider that all links which do not belong to any mscs do in fact 
belong to a 'virtual' mscs. 



-66- 
The Jiang -up states of simple graphs can be characterized in 
term, of a counting property of links belonging to the same mscs and 
links attached to loop junction - loop output pairs. Figure 3. 9 defines 
the link names used in Theorem 3. 6. If I is a link, (I ] denotes the muriber 
of times that I is enabled or disabled during an execution sequence. 

Theorem 3JI_ The final state of a terminal execution sequence of 
a simple program graph is not a hang -up state iff the following two 

conditions are satisfied: 

1. For each loop junction - loop output pair {1 2 ] =1 * 3] =1 '4] = 

2. If I. and I. belong to the same macs then[ I. ] = [I j ]• 

Proof: If P is cycle free, condition 1 does not apply and condition 2 
becomes the statement of Theorem 3. 2. Thus, it suffices to assume that 
P is cyclic. The proof invokes certain properties of the transition tables 
obtained by exhaustive case analysis. Because performing the case 
analysis each time becomes extremely tedious, we will just list these 
properties here and defer their detailed verification to Appendix B. The 
properties are grouped according to the node types to which they apply. 

Loop junc tions - loop output pair 

»• |lj] = [< 6 Jiff ij and '3 a r e idle 

Lo op ju n ction s 

b. If t is idle then: 

[l 2 j = 1 l 4 l iff[ l 2 ] =[ i 3 l. I 2 and l 4 are idle. 

c. If f j. ! 2 . ! 3 , ! 4 are idle thenl! 2 ] = [! 3 ] =l! 4 l 
Operators, selectors, junctions, and loop outputs 

d. Each input link has been enabled or disabled n times iff 
either all input links are idle or all are non-idle. 
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Fig. 3.10 The Link Names of Operators, Selectors, am 
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C ) pe r a to r s , s e loc lorj^^J^f U ''iilE-U."" - 

e. Tf /. and I. are input and output links respectively then: 

| IjlM'jl i«'i i* idle- 
To show that conditions 1 and 2 imply that all links are idle in the 

final state, we divide the nodes into two classes: 1) operators, selectors, 

and junctions, and 2) loop junctions and loop outputs. For each class we 

show that each of their input links has the desired property and thereby 

cover all the Jinks of the graph, since links attached to output terminals 

are inconsequential. 

In Figure 3. 10, let the node represent an operator, selector, or 
junction. If the input links *. and I . belong to mscs's Kj and K 2 respectively, 
then £., the output link, belongs to both Kj and K 2> By condition 2, 
[l.iri | ] = [| . j and by property e both lj and i . must be idle. Clearly, the 
same argument can be applied for any number of inputs. Now consider 
Figure 3. 9. Since the graph is simple, every loop output is paired with 
precisely one loop junction as illustrated in the Figure. By Definition 3. 
I. and I, belong to the same msc s, and by condition 2, [ 1 j] ={ 1 ^]. 
Therefore, by property a both I { and I 3 are idle. By condition 1,[ 1 2 ] =[ * 4 ] 
and by property b, [ t z ] = [I 3 J and 1 2 and l 4 are idle. This shows that 
both inputs of the loop junction are idle. We also have that * 3 is idle and 
by condition 1, [ t 3 ) = [Ig.]. Therefore, by property d, * 5 must also be idle 
and this completes the first half of the proof. 

Next, we show that conditions 1 and 2 are necessary as well. Thus, 
assume that all links are in idle status. In particular, for any loop junction 
l r l 2 ,l 3 ,l 4 are idle. Thus, by property a, [1 j ] = [I 6 ]and by property c_ 
[*_] =[* 3 ] = M 4 ]- Finally, by property d[ I 3 ] =[ I J and thus follows 
condition 1. To show that condition 2 is also implied, we just reverse 
the argument using Figure 3. 10 and condition e. This completes the proof. 

Q. E. D. 
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Corollary 3. 3 Let gj and g 2 be loop junctions contained in the 
G-set of an mscs of the cycle structure of a simple graph P. The final 
state of a terminal execution sequence is not a hang -up state, only if 

1<2<M =t'4<M ^'ztez" S ^4^Z )] * and[ ' i l <g l )1 =li l (g 2 )] ; 

Proof: Immediate by observing that l^gj) and t^gj belong to 

the same mscs. 

Q. E. D. 

Corollary 3.4 Let gj and g 2 be loop junctions contained in the 
G-sets of mscs's K { and K £ of a simple graph P respectively. If there 
exists a link I in P which belongs to both K l and K.,, then the final state 
of a terminal execution sequence is not a hang -up state only if 

[* 2 (g,)J =[' 2 <g 2 >)= [< 3 <gi>] =H 3 <g 2 >]=M 4 M s l'4 { *2 )] - 

Proof: I must be the output connector of a node as shown in 

Figure 3. 10. By first applying condition 2 and then 1 we obtain the desired 

re8ult - Q. E. D. 

If we view the links of the graph as providing channels for the 
flow of control information, Theorem 3. 6 says that there must exist a 
certain balance of in-flow and out -flow at each node and at each cycle. 
The next theorem shows that in order to preserve this balance, and there- 
by avoid hang -up states, communication between cycles should be restricted 
when the cycles are not contained within mscs's of the cycle structure 
sharing common nodes (i. e. mscs's that are not disjoint). The essence of 
this constraint is shown in the proof of Lemma 3. 5. We need two pre- 
liminary lemmas relating the initial and feedback inputs of loop junctions 
to the cycle structure of simple graphs. 



* *(g) denotes the named link of loop junction g with reference to 
Figure 3.9. 
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Lcmma 3. 3 Let P be a simple graph, K. an mscs of its cycle 

structure and g a member of the G-set of K . • If I j is the 

initial input of g. , then I. belongs to an mscs K^, where KjCK^ 

or Kj K 2 = 0. 

Proof: Assume the lemma is false, then K 2 - K l' This implies 

that there is a path from g to every g 2 c K^. Since I j belongs to K^, 

there is a path from some g 2 to g { and the last link in this path is 

I . Therefore, there is a cycle in K. involving l^ and either gj is not in 

the G-set of K or P is not simple. In either case we obtain a contradiction. 

Thus, either KjC K 2 or r^n K 2 = 0. 

Q. E. D. 

Lemma 3. 4 Let P, K and g be as in Lemma 3. 3. If * 2 is 
the feedback link of g., then I- belongs to K^, where r^E Kj. 
Proof: If K. c K, or K.n K_ = 0, both inputs of gj have direct 

ancestors not contained in K.. Consequently g. e K. which contradicts 

the hypothesis. Thus, K ? <EK.. 

Q. E. D. 
Lemma 3. 5 Let i. and I . be links belonging to mscs's K. and 
K. of a simple program graph P. Let g. be a loop junction con- 
tained in the G-set of K.. If K. cK. and [ I.J =[!.], the final 

i i J r, J 

state of an execution sequence is not a hang-up state only if 

[i 2 ( 8i>] = t* i<«±> J - 

Proof: Since K.cK., there must exist a loop junction g « G. 

and an mscs K' such that I . (g ) belongs to K' and K C K.. For, 

s 1 °r s 8 j 

by lemma 3. 3, if such e did not exist it follows that K K. = and- 
7 °r si 

therefore K. = K.. Now by Theorem 3. 8 we have: (See Figure 3. 11) 
l' 2 (g r >] = M4(8 r )l (2) 
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If g 1 is a loop junction in the G-set of K l g , since l 4 (g l 8 ) belongs to the 

" 8 

same mscs as I ,(g r ) it follows that: 

lM(8 r )l = l i 4<88 , l (3) 

If K i K., we can apply the same process yielding at the m^ step the 

8 •' 

relations (see Figure 3. 11) . 

i',C"''i ■ fVC'i <6) 

At the n 1 ]} step K. is reached, by Theorem 3. 8 

IM - tv = mX'i (7) 

Substituting back into each set of relations using (4)>. (6), and (7) 
we obtain: 

[h<*T l "zi l i ] (8) 

Using (8), (5), and (3) we obtain: 

[i^g^" 2 )] > iv (9) 

This process is repeated as often as needed using the appropriate 
instances of (4), (5), and (3), finally yielding: 

[<2<e r >l 1 l'i (g rM Z IM (10) 

But 

which when substituted in (10) yields 

[< 2 (g r )l = C*!(B r >] (12) 

By Corollary 3. 3 

[i 2 (g r )l = l' 2 (g i )] and ['l (g r )] = [/ l (g i )] 
From these two equalities and (12) we obtain 

l* 2 <gi>] = Mi<8i>l 

as required. 

Q. E. D. 
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Fig. 3. 1 1 The Link Names in the Iteration Step of Lemma 3. 5 
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Theorem 3. 9 Lei g. and g_ be loop junctions contained in the 
G-sets of mscs's K { and K 2 respectively, where Kj cK^ If 
there exists a link i which belongs to both K^ and K 2> then the 
final state of a terminal execution sequence of P is not a hang-up 

state only if [ i 2 (g 1 )] = [^(gj)]- 

Proof: There must be an operator, selector, or junction which 
has inputs belonging to K, and K 2 respectively. Then the theorem follows 
immediately from Lemma 3. 5. 

The following corollaries of Theorem 3. 9 relate the cycle structure 
to sources of hang-up states. The cycle structures are sketched in Figure 
3. 12 where each circle denotes an mscs. 

Corollary 3.5 If a simple graph P has a node other than a loop 
junction with input links belonging to mscs's K^ and K^ and KjC K^, 
then either no cycle of K . is ever effective or P has a hang -up state 
for some execution sequence. 

Proof: By Theorem 3. 9, for each loop junction gj of K^ 
[ i ? (gi)l =[ * jtg,) 1 or there is a hang-up state. But this condition 
merely says that the feedback link of a loop junction is enabled or disabled 
the same number of times. This must occur for every execution sequence. 
Thus, for no execution sequence does the cycle repeat. 

Q. E. D. 

The proof of the remaining corollaries is completely analogous and will 
not be given. 

Corollary 3. 6 If a simple graph P has two nodes a^ and a 2 with 
input links belonging to mscs's Kj and Ky and K 2 and K^ respectively, 
where K.C Ky and K.CK,, then either no cycle of Kj is ever effective or 
P has a hang -up state for some execution sequence. 
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(b) 




(c) 



Fig. 3. 12 Diagram of Paths Between mscs's which 
May Cause Hang -Up States 
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CorollarxAZ Let P be a simple graph, K 2 an mscs of P, and 

g, a loop junction in the G-set of K-,. If the feedback link of g[ belongs to 

an mscs Kl and K^ K.,, then either no cycle of Kj is ever effective or P 

has a hang -up state for some execution sequence. 

Combining Lemma 3. 4 and Corollary 3. 6 we obtain: 

Corollary 3.8 Let P, K.,. and gl be as in Corollary 3. 6. If the 

feedback link of gl does not belong to K.,, then either no cycle of any mscs 

K where K.c K ? is ever effective or P has a hang -up state for some 
1 id 

execution sequence. 

Corollaries 3. 5 and 3. 6 tell us that a node in an inner cycle should 
not depend directly on a node in a containing cycle unless the node in the 
inner cycle is a loop junction. Corollary 3. 7 tells us that loop outputs 
have to be used in order to nest cycles. For example, in the graph of 
Figure 3.4a loop junction gj does not satisfy the condition of Corollary 
3. 7. We have already seen in Section C how the hang -up states of this 

graph arise. 

3. Graphs of Type I 

We will now restrict our attention to a class of program graphs 
having the property that a hang -up state can arise only if two input links 
of a junction are placed in enabled status during an execution sequence. 
Graphs with this property will be called graphs of type I. Under suitable 
assumptions on the behavior of the selectors, we will give a procedure to 
test whether or not hang-up states can arise in graphs of Type I. 

The motivation for the following definition comes from Corollary 
3. 8 which states that if the feedback input of a loop junction in the G-set 
of an mscs does not belong to the mscs, then all cycles of inner mscs's 
are useless. Thus, if we require that the feedback input of a loop junction 
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belong to the same mscs as the outputs of g, we do not seriously restrict 
the class of program graphs. If, in addition, we require that both inputs to 
a loop output belong to the same mscs, then condition 2 of Theorem 3. 6 
implies condition 1. 

Definition 3. 5 A simple graph is said to be of Type I only if: 

1. The initial inputs of all loop junctions in the same G-set belong 
to the same mscs. 

2. If a link I belongs to mscs's Kj and K 2> then the initial inputs 
of g. and g 2 , where gj£ Gj and g 2 e Q> v belong to the same 



mscs. 



3. The input links of every loop output belong to the same mscs. 
Corollary 3. 9 The final state of a terminal execution sequence of 
a graph of Type I is not a hang -up state iff whenever I. and 1^ belong to the 

same mscs, [1^ ] =[ t ■] • 

Proof: Immediate from the definition and Theorem 3. 8. 

If P is a graph of Type I, we associate enabling function's with the 
links of P in the following manner: Let P n be the cycle free graph generated 
by the cycle decomposition of Pi Every link of P is also a link of P . 
To obtain the enabling functions, we apply, in P n , rules 1 through 5 of 
Section C. 3 plus the following three additional rules to deal with loop 
junction and loop outpvits. 

6. If 1 is the data output link of a loop junction g assign to it the 
function E. associated with the initial input of g. 

7. If ! is the control output link of a loop junction g assign to 
it the function E 2 associated with the feedback input* of g.- 



* The feedback input of g is not attached to the loop junction in the graph 
P n . 
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Fig. 3. 13 The Enabling Functions of a Cyclic Graph 
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8. If I is the output link of a loop output assign to it the function 

E. v E, where E and E~ are the enabling functions associated 
1 c. 1 £» 

with the input links. 
Rules 7 and 8 define the enabling function of the output link of a loop output 
in terms of the function of the feedback input of the associated loop junction. 
Since the definition of graphs of Types I require that the initial and feed- 
back inputs of a loop junction belong to different mscs's, it follows, by 
Lemma 3. 3, that the enabling function of each link is uniquely defined, i. e. 
application of rules 6, 7, and 8 will not give rise to an endless loop. 
Figure 3. 13 illustrates the application of these rules for the graph previously 
decomposed in Figure 3. 8. The interpretation of the enabling function 
associated with links of loop outputs by rule 8 is, as with all other enabling 
functions, that the link cannot be enabled when the value of the function is 
false. By checking the transition table for loop outputs and keeping in mind 
rule 7, it can be verified that the assignment of rule 8 is consistent with this 
interpretation and the conventions established in Section C. 3. 

Strictly speaking, the enabling functions associated with the links of 
P n are applicable only to those execution sequences during which no cycle 
of P repeats. However, in order to guarantee that no hang -up states can 
occur, the enabling functions of feedback inputs of loop junctions covered 
by 1 and 2 of Definition 3.5 have to b e equivalent (i. e. they must be false, 
and therefore the link disabled, under the same conditions). For, it is 
clear that if this condition is not met, then we could find execution 
sequences for which corollary 3. 9 is not satisfied. This is illustrated in 
the example of Figure 3.14 where the output link of the operator labelled 
f, belongs to both mscs of the graph. The cycles of each mscs are indepen- 
dent of the other. Thus, during some execution sequence one cycle is 
enabled more times than the other and a hang -up state thereby arises. 
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Fig. 3. 14 A Possible Hang-Up State Arising from macs with 
Different Feedback Enabling Functions 



-80- 
We formalize this observation as follows: 

Lemma 3. 6 The final state of each terminal execution sequence 
of a graph of Type I is not a hang -up state only if the enabling 
functions of the feedback input links of loop junction satisfying 
1 and/or 2 of Definition 3. 5 are equivalent. 

It is convenient to introduce the term G*-set to denote the union 
of the G-sets of the mscs's K, and K_ such that there exists a link be- 
longing to both K, and K,. Clearly, any two G*-sets are disjoint. To 
extend the enabling function to those execution sequences where cycles 
repeat, we observe that whenever the feedback input of the loop junctions 
of a G*-set become enabled, the next value of the enabling function can be 
obtained by simply setting the data output link of all members of the G*-set 
to the identity function. The enabling functions so obtained applies to all 

succeeding repetitions of the cycles, and should also satisfy Lemma 3. 6. 

n' 
We will call these functions the P enabling functions. 

Theorem 3. 8 Let P be a graph of Type I. The final state of all 

* 
terminal execution sequences of P is not a hang-up state only if : 

1. The P n and P enabling functions of the feedback inputs of 
all members of each G*-set are equivalent and different from 
the identity element. 

2. If E. and E. are the P n (P n ) enabling functions of two inputs 

J 

of a junction, then E. A E. — false. 

i J 

Proof: The first half of part 1 follows directly from Lemma 3. 6. 
The second half, i. e. that the enabling function be different from the 
identity element, is also needed. For, otherwise the feedback links of 
the corresponding G*-set will never be disabled and therefore they 
could not be in idle status in the final state. 



* As in Section C. 3, here we assume that no two selectors of P have the 
same label. 
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In order to show the necessity of part 2, consider the possible 

execution sequences of a graph in the light of its cycle structure. First, 

„n 
if the condition E. E. false is not satisfied for some junction in k> , 

then, by Theorem 3. 5, there is at least one execution sequence during 

which a hang-up state occurs, i. e. that sequence during which no cycle 

of the graph repeats. Now, let Kj. K-,, . . . K r be the mscs's in the first 

level of the cycle structure. Set the output links of the loop junctions in 

their G-sets and compute the P n ' enabling functions for all links belonging 

to an mscs K, where K K., 1 <i < r. AH other links of the graph are 

discarded. By the definition of the G*-sets, the result is a set of disjoint 

graphs such that the data output links of a G*-set obtained from Gj, G^ ...G r 

correspond to the input terminals of a graph. The argument used for the 

P n enabling function is valid for each of these graphs and consequently 

E A E = false at each junction as well. This process is repeated until 

i J 
the cycle structure is exhausted. 

Q. E. D. 
The proof of Theorem 3. 8 contains the essence of a procedure to 
test whether a graph of Type I has hang -up states under the assumptions 
that all selectors are distinct and independent of one another. 



IV. AN EQUIVALENCE PROBLEM 

A. INTRODUCTION 

The determinism of program graphs guarantee not only the unique- 
ness of the final state of terminal execution sequences with the same initial 
state, but also the uniqueness of the sequence of value and status pairs at any 
link. It is often the case that we are interested in observing identical 
value and status pairs in a subset of the links of the graph. Under these 
circumstances, the following two problems are of interest: 

1. To determine of two program graphs P. and P ? whether or 
not the value and status of a given link of P. is the same as 
the value and status of a given link of P ? . 

2. To determine what kind of transformations can be performed 
on a program graph Pj so that the transformed graph P_ is 
equivalent (in the sense of 1) to the original graph P.. 

In this chapter we consider both of these problems when two values 
are to be considered the same if and only if they have identical functional 
expressions after elimination of identity functions. For example, if I denotes 
the identity function, then 

fjfKf^x.y)),*!)- f l (i 2 {x,y),I(z)) 

Section B presents a solution to the equivalence problem for graphs 
with a known, simple structure. Section C formalizes and generalizes the 
reasoning of Section B to program graphs with almost arbitrary structure. 
Theorem 4. 1 in that section establishes necessary and sufficient conditions 
for the equivalence of two program graphs. Finally, Section D considers 
certain simple equivalence -preserving transformations. 
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D. A SIMPLE EQUIVALENCE PROBLEM 

Lot us consider the following problem: we are given two program 

graphs P and P, -- whose structure is known and is as shown in Figure 

4. I. Specifically, we know that both graphs have precisely one maximal 

strongly-connected subgraph, i.e. the boxes labelled Hj , H^ F^ F 2 - 

G . G , V , and V ? in Figure 4. 1 are cycle free. Furthermore, we know 
1 2 1 <S 1 2 

that a cycle occurs in either graph only if the selectors labelled 0j and pj 

respectively enable the connectors labelled • + '. Both graphs have the same 

number of input terminals and loop junctions, and there are no hang-up 

states in either one. We are asked to determine whether or. not the value 

and status of the links labelled I { and I 2 in Pj and P 2 respectively are the 

same for all sets of input values when the input terminals of both graphs 

are identified as indicated by the dotted lines in the figure. Assume for 

the moment that p\ and $\ are the only selectors in both P { and P.,. Now 

assume that it is possible to find execution sequences of P 2 which yields 

a value at l 2 identical to the value obtained at I j when the first activation 

of 6 1 in P enables the connector labelled '-', and when the first activation 
K l 1 

of p 1 enables its ' + ' connector and the second activation enables its '-' 
connector. Similarly, assume the same thing holds true when the roles 
of P and P-, are reversed. We claim that these two conditions imply 

the following: 

1. F 1 H 1 (x)=F 2 H 2 (x) 

2. F^lyl^F^ly) 

3. V^z) =V 2 (z) 

and it is clear that 1,2, and 3 imply that to each execution sequence of P^ 
producing any value at ^ there corresponds an execution sequence of P 2 
producing the same value at I 2 and vice versa. 
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Fig. 4. 1 Cyclic Graphs with the Same Cycle Structure 
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Let o\, <J denote the two chosen execution sequences of Pj and 

1 2 
°Z' °2 tno8e °* ^7' 

For each of those sequences let us write the expression corres- 
ponding to the value and status of i , , f 2 as follows; 

• a\ : p^F^H^xm-V^F^H^x))) 0) 

a* : P^F^H^xJ^Ap^F^G^F^Hjtxjm^V^FjtGjtF^H^x))))) (2) 

a\ : P 1 "(F 2 (H 2 (x)))-V 2 (F 2 (H 2 (x))) (3) 

o\ : p{(F 2 (H 2 (x)))Apj(F 2 (G 2 (F 2 (H 2 (x)))))-*V 2 (F 2 (G 2 (F 2 (H 2 (x))))) (4) 

The expression on the left hand side of the arrow denotes what 
sequence of selector outputs must be enabled in order for the value on the 
right hand side of the arrow to appear at the chosen link. 

Now suppose that O. is matched with Oy and O. is matched with 
o\, i.e., V 1 (F 1 (H 1 (x)))eV 2 (F 2 (H 2 (x))) and Vj (Fj (G^Fj (Hj (x))))) ■ V 2 (F 2 
(G 2 (F 2 (H 2 (x))))). 

In order for the left hand side of the arrows in (1) ar d (3) to be 
enabled under all circumstances we must have F.H^s F 2**2' From tn * 8 
identity and the identity of the right hand sides it follows that Vj s V^. 
A similar argument using the identity of (2) and (4) yields F.GjS F 2^ J 2" 

On the other hand, if FjHjS F 2 H 2 then (1) and (3) cannot be 

matched even if VjfFjfH^x))) - V 2 (F 2 (H 2 (x))) for we haVe n ° as8urance 
that pJ(F (Hjfx))) = p 1 "(F 2 (H 2 (x))). Analogously, (1) and (4) cannot be 
matched either; in fact (1) cannot be matched with any execution sequence 
of P 2 . Similarly if FjG s F 2 G 2 , (2) cannot be matched with any 
execution sequence of P, either. This, however, contradicts the hypothesis 
and we must conclude that the only possible match is (1) with (3) and (2) 
with (4) which proves our original claim. 



-86- 

If we now allow Hj , H^ F { , F^ Gj , G^ Vj , and V 2 to be arbitrary 
cycle free graphs, the same reasoning still holds by considering every 
execution sequence which results in a different combination of selector 
connectors being enabled. The detailed justification of this assertion is 
best left to the jiext section. 
C. THE EQUIVALENCE PROBLEM FOR ARBITRARY GRAPHS 

In order to apply the foregoing reasoning to arbitrary program 
graphs we must be able to express the same concepts without any know- 
lege of the cycle structure. The concept of base sequences is introduced 
with this aim. 

Definition 4. 1 A base sequence of a program graph P is a normal 
execution sequence during which at least one link of every proper cycle of 
P is enabled at most once. 

Corollary 4. 1 Every program graph has a finite number of base 

sequences. 

Proof: Immediate from the definition and the fact that there are 
a finite number of proper cycles in a program graph. 

The definition of base sequences immediately yields the following: 

Corollary 4. 2 If a. , a 2 are two nodes of a program graph P and 
there exists a proper path from aj to a 2 all of whose links are enabled for 
some execution sequence of P then there is a base sequence of P during 
which these links are also enabled. 

Corollary 4. 3 Every execution sequence of a cycle free program 
graph is a base sequence. 

Definition 4. 2 An infinite cycle is a data cycle all of whose links 
are enabled for all execution sequences. 
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A program graph with an infinite cycle never reaches a final 
state. Infinite cycles can be detected by examining the relationship between 
the cycles and selectors of a graph. 

Appendix A contains an algorithm to determine whether or not a 
program graph has infinite cycles and/or hang -up states. Furthermore 
the algorithm generates all the base sequences of the graph if neither of 
the above conditions are present. 

We shall henceforth consider program graphs without infinite 
cycles and/or hang-up states. 

If I is any link of a program graph, its value and status are, 
according to Theorem 2. 2, uniquely defined for every execution sequence. 
Accordingly, the execution sequences; can be grouped into equivalence 
classes with respect to t_ as follows: 

Definition 4. 3 Two execution sequences are in the same equiva- 
lence class with respect to a link i_ if and only if the value and status of 1_ 
are identical upon completion of both sequences. 

Since the value of a link is considered to be undefined when the 
link status is not the enabled status, there is one equivalence class for 
all sequences during which the link is not enabled. 

In order to study the equivalence between program graphs we 
need only consider a suitable representative of each equivalence class. 
For this purpose we need a precise description of the circumstances 
under which a particular value is assigned to a link. It is rot enough to 
know that the link is enabled. We also need to know what selector 
terminals are enabled when a value is obtained at the link. We will . 
represent each equivalence class of execution sequences by a pair of 
functional expressions. The first member of the pair denotes the condition 
under which that value is obtained. The second member of the pair denotes 
the value assigned to the link. The condition part is a boolean expression 
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using the connectives » A ' (AND) and ' ' (OR) among terms of the form: 
p + (y , . . . y ) or p~(y, , . . . y ) where y. are any functional expressions de- 
noting the values of the input links of the n -place selector p\ 

The notation is best clarified by an example. The pair: 

i : p{(a 1 )AP2(f 2 (a 1 ,a 2 ))vP 1 "(f 3 (a 1 ))- f ^(^ , a.,), f 3 (a 1 )) 

denotes that link i_ is assigned the value {^{^(a^, a^), i^ia^) if either 
selector p, enables its ' + ' connector when its input has the value a^ and 
selector p ? enables its '-' connector when its input has a value * 2 ( a i • a 2^' 
or when selector p. enables its '-' connector when its input has a value 

f 3 (a 1 ). 

Note that the first member of the pair is closely related to the 
enabling function used in Chapter III. There it was specifically assumed 
that all selectors of a program graph were distinct and therefore it was 
sufficient to consider only the selector label. In the context of this 
chapter such an assumption is too restrictive, yet the need to uniquely 
distinguish each selector value is preserved by the use of the functional 
notation as above. 

The two members of a pair characterizing an equivalence class 
of execution sequences will be called dynamic enabling function (def) 
and value respectively. 

Given two dynamic enabling functions it is possible to determine 
whether or not they are equivalent by replacing each expression of the 
form p* (. . . ), p."(. . . ) with single boolean variables according to the 
following rules: 

1 . Two expressions ^ (y l , y 2 « . . . y n ) and p (y 1 , y 2> . . . y n ) are 

i t 

assigned the same variable iff i = j, y . £ y., 1 <i< n - 



-89- 



2. If 6 + (y . y 7 , • • • Y ) is assigned the variable B^ then 

p."(y . y 2 . • • • Y n ) is assigned its negation B. 
From the foregoing and the definition of equivalence class we 

obtain: 

Corollary 4. 4 Two execution sequences belong to the same 
equivalence class with respect to a link t_ iff their characterizing pairs 
exhibit identical valueB and equivalent dynamic enabling functions. 

Now we give a precise formulation of the equivalence problem for 

program graphs. 

Let P and P 7 be two program graphs without infinite cycles and/ 
or hang -up states. Nodes of Pj and P 2 tagged with the same label denote 
the same function or predicate. Furthermore, we assume that if p. is 
an n-place predicate and y { and y., are n-place value expressions, the 
only constraint on the value of 0. is that p+ [yj and ?.>.,) may occur during 
the same execution sequence only if Yl * Y r Let the input terminals of 
P and P 2 be denoted by Oj , a^ . . . a n and a\ , q 2 , . . • a^ , respectively. If 
I and i 2 are links of Pj and P 2> the notation ijfa^ a 2 , . . . a n ) and 

* (a' a' , a' ) denotes the value assigned to the links as a function of 
1 l v 1 ' 2 m' 

the values assigned to the input terminals of Pj and P 2> respectively. 

Let X denote the set of values which can be assigned to these input terminals 

and $ a mapping which associates each cu, a { with a member of X. 

Definition 4. 4 P 1 and P^ are equivalent with respect to ^ andj ? 
under the mapping $ iff to every equivalence class of the execution 
sequences of P, there corresponds an equivalence class of the sequences 
of P 2 such that 1 jWoj), *(o 2 ), • • • *(a n )) = i^®^),® (a^), . • ® (<* m )) and 
the corresponding dynamic enabling functions are equivalent. 
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This is a very strong definition of equivalence. It requires that 
to earh sequence of functional applications of one graph there corresponds 
an identical sequence of the other graph. Furthermore, it assumes that 
it is always possible to assign to a selector p a predicate function such 
that if y, and y 2 are suitable arguments of this predicate and yj £ y 2 then 
either P + (y,) or p"(y 1 ) may be enabled concurrently with p (y 2 ) or p (y 2 ). 

This form of equivalence is closely related to the equivalence of 
program schemata as defined by Ianov. There are two important dif- 

ferences, however, which makes our definition a non-trivial generaliza- 
tion of Ianov's. First, we specifically require that during no execution 
sequence it occurs that p.(x) and p7(x) are enabled; second, we allow 
functions of any number of arguments and parallel evaluation of functions. 

Neither of these situations can be expressed in Ianov's program 
schemata which can only represent strictly sequential application of 
single-input, single-output functions and where the predicate variables, 
which perform the selection function in program schemata, are distinct 
and their values at any one time are independent of the past history of the 
process. In fact, Rutledge has shown that program schemata are equiva- 
lent to finite state devices whose inputs are sequences of allowable predi- 
cate variable vectors and whose outputs are sequences of operators (i. e. 
values so defined by Ianov). This implies that the allowable input and 
output sequences of program schemata are regular sets. This assertion 
does not hold, in general, for program graphs even if the first condition 
mentioned above were not required. 

The following theorem gives necessary and sufficient conditions 
for the equivalence of two program graphs in terms of the base sequences 
of each graph. 
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Theorem 4. 1 Let Pj , P 2> # , I j . and i 2 be as before. Pjand 
P are equivalent iff to every equivalence class of the base 
sequences of P, there can be found an equivalent class of execu- 
tion sequences of P 2 and vice versa. 

Proof: If P, and P ? are equivalent, the condition of the theorem 
must be satisfied since otherwise we would have found an execution 
sequence of P, not equivalent to any execution sequence of P 2 or vice 



versa. 



Next, we show that if the condition of the theorem is satisfied, to 
every execution sequence of Pj, there can be found an equivalent execu- 
tion sequence of P 2 and vice versa. 

If none of the links of Pj and P 2 are enabled more than once for 
any of their base sequences, then by Corollary 4. 2, neither Pj nor P 2 
have any effective cycles and by Corollary 4. 3 it follows that the condition 
of the theorem considers all execution sequences. 

Now assume that there is a base sequence of P ^ during which some 
link is enabled more than once. 

We recall from Chapter III that every cycle of a program graph with- 
out hang-up states must pass through a loop junction. Since all inputs of 
loop junctions are data links, it follows that every cyclic graph without 
hang -up states does not have control cycles. If during any execution 
sequence any link is enabled more than once, all links of some cycle must 
have been enabled. 

P. and T? 7 do not have any infinite cycles. This can occur only if 
for each proper cycle there is at least one selector capable of disabling 
(and therefore also enabling) a link of the cycle. 



-92- 

Let B = 3 , . . . , 3. be the set of selectors of P. which has the 
1 n 

afore mentioned property for a given cycle. 

From the definition of base sequences, there are such sequences 
during which the values assumed by members of B disable this cycle, 
and there are other base sequences during which the cycle is first enabled, 
then disabled. We shall refer to these base sequences as acyclic and 
cyclic respectively. Note that a sequence acyclic with respect to a cycle 
may be acyclic or cyclic with respect to another cycle. If a cyclic base 
sequence is in the same equivalence class as an acyclic one, then there 
is no execution sequence during which all links of the corresponding 
cycle are enabled more than once, i. e. , all execution sequences involving 
the cycle are base sequences (e. g. , the example of Figure 4. 3). On the 
other hand, if a cyclic base sequence is not in the same equivalence class 
as any acyclic one then the cycle may repeat any number of times. 

Our first task is to show that the condition of the theorem implies 
that to every such cycle in P. there corresponds an identical cycle in T?^. 
The dynamic enabling function of the cyclic base sequence of P^ must 
have two instances of each of the members of the set B of selectors. 
Each of these instances must have at least one of its arguments different 
from the corresponding argument of the other, for otherwise the graph 
has infinite cycles. Since by hypothesis we have found an equivalent execu- 
tion sequence a of P ? , there are instances of members of B in P2 which 
either are in cycles having the same relationship to a cycle as in Pj or 
are not contained in any cycles. If it is the latter case, then there must 
exist a base sequence of P 2 identical to the sequence or up to the second 
activation of members of B at which point, one or more members of B 
enable the complementary connectors instead. This second activation, 
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therefore, yields values corresponding to the repetition of the cycle of Pj. 
It follows that the sequence of P. equivalent to this base sequence of P 2 
enables the cycle once more and therefore the corresponding def 
has a third distinct instance of members of B. By repeating this argu- 
ment as often as needed we conclude that either there are an infinite 
number of instances of B in T? z or there is a set of these instances con- 
tained in some cycle. But the first alternative is not possible since a 
program graph is finite. 

An entirely parallel argument can be used when the set B deter- 
mines a data cycle of P,. 

The foregoing construction also shows that to any execution 
sequence of P, which enables a cycle any number of times, there corres- 
ponds an equivalent sequence of P 2 and vice versa. Thus, now we have 
shown that in addition to the base sequences, all sequences of one graph 
enabling one of the cycles an arbitrary number of times and all other 
cycles at most once have an equivalent sequence in the other graph. Using 
the correspondence of cycles and an analogous reasoning we conclude 
that the set of equivalence sequences can be extended to include those in 
which two cycles are repeated an arbitrary number of times and so on 
until all cycles are considered and therefore all possible execution 

sequences. 

Q. E. D. 

We illustrate the application of Theorem 4. 1 by working out several 
examples. Throughout these examples we shall omit parentheses from 
functional expressions. 

Example 1 . We want to determine whether or not the graphs 
P and P, shown in Figure 4. 2 are equivalent with respect to the links u>j 
and <*Xp. 
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P has two base sequences corresponding to the proper cycle 
passing through nodes gj . f j . and i^. 

CT ! : P"i f l a - f 6 f 5 f 3 £ l af 4 f 3 f l a 
and 

<j\ : P;f 1 aAp-f 1 f 2 £ 1 a-f 6 f 5 f3f 2 f 1 af 3 £ 1 f 2 f 1 a 

P has four possible base sequences corresponding to the proper 

cycles passing through nodes g^fj. and g 2 and g 3> f x , and i^ 

o\ : P^aAP^a-f^^af^a 

4 : Pi" f 1 f 2 £ l QAp l f l aAP l" f l a ^ f 6 f 5 f 3 f l f 2 f l af 4 f 3 f l Q 
4 '■ Pi" f i QA Pi f l f 2 f l aA Pl f l a "* f 6 f 5 f 3 f l af 4 £ 3 f l f 2 f l a 

However, CT? and ol can not be execution sequences since both 
p + f a and p" f a occur in their defs. It is readily checked that Oj s a 2 
and o? s a 2 and thus Pj and P 2 are equivalent. 

Example 2. Pj and P 2 are as shown in Figure 4. 3. Pj has eight 
possible base sequences corresponding to the proper cycles passing through 
nodes g . , f 2 - 1 and g 2> i^, iy 

a \ : p^aApJfjd — f^jci 

a 2 x : p^aAp^f^Ap^^fjaa — f^fjaa 

a\ : p^oAPjfjaAp+f^aaAPjIfgfjaa-^f^yjQO 

a\ : pJo/kP^fjaAPj^fjOoAp^fjOaAPjf^fja^^fjaao 



-.f 4 f 2 If 2 f 1 aaf 3 f 2 f 1 aaQ 



a, : p'oAP.f.o—f.f.o 



1 • > , 2 ^l i l u Vl' 

x : p^oAPJfjaAPjf^jOa — i^ij' 



a, : pZaApr^aAp.fpf.aa— -^fpfHaa 
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a l : P2 QAP i £ l aAP l f 2 f l QQA(3 l If 2 f l aa Pl £ 2 I£ 2 f l aof 3 f 2 f l aaa 

-.f 4 f 2 I£ 2 f 1 aaf 3 £ 2 f 1 aaa 

After eliminating identity functions (I) from all expressions, there results 
the following equivalence classes: 

(<V a i 5 > : ^-Vi* (1) 

Hf.af.of.oJ): p-f 1 a-.f 4 £ 2 £ 1 aa (2) 

where o\ and CT® have been eliminated because both p^fjCta and p^fjOa 
appear in their defs. The equivalence classes in (1) and (2) are in one to 
one correspondence with the two base sequences of P^. 

In order to establish that the equivalence problem is solvable, 
all that remains is to show that there is an effective procedure to test 
the conditions of Theorem 4. 1. 

The algorithm of Appendix A generates all the base sequences of 
a program graph. Determining the equivalence of two dynamic enabling 
functions is a solved problem of the propositional calculus. The only re- 
maining difficulty is to find an execution sequence of a graph equivalent 
to a base sequence of the other. If such a sequence cannot be found, it 
is conceivable that we may never know when to stop the search. That this 
is not the case is easily discernible from the fact that for two sequences 
to be equivalent, their values have to be identical. Therefore, all we have 
to do is generate all possible values whose lengths are less than or equal 
to the length of the longest value in any base sequence. By a simple " 
modification, the algorithm of Appendix A can be used for this purpose. All 
that i 8 needed is to place a higher upper bound in the number of times a 
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Fig. 4. 4 Transformations to Identify Common Subgraphs 
Disregarding Selectors and Junctions 
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cycle is allowed to repeat. If L is the length of the longest value in any 
base sequence and I is the length of the shortest cycle in the program 
graph then L/i+ liaa suitable upper bound. 

We formalize these observations in the following theorem. 

Theor em 4.2 The equivalence problem for program graphs 

is solvable. 
D. SIMPLE TRANSFORMATIONS 

In this section we will briefly indicate by means of examples 
the application of the results of the previous section to obtain equivalence 
preserving transformations of program graphs. In general, we seek to 
transform a graph in order to optimize a given criterion. For example, 
we may wish to minimize the number of operators and selectors associated 
with functions and predicates by identifying all identical subcomputations, 
or we may wish to transform a graph so that a function or predicate is 
applied only if the results of each application will actually be used by 
another computation during the course of the execution sequence; alternatively, 
we may want to speed up the average time of an execution sequence by per- 
forming as many computations as possible in anticipation of the possible 
utilization of their results, etc. 

Ideally, we would like to obtain a set of elementary transformation 
schemes such that : 1) each scheme can be applied independently of each 
other to yield an equivalent graph, 2) the value of the criterion function in 
the transformed graph is not less (greater) than the corresponding value 
in the original graph, 3) each transformation is local , and 4) the set of 
transformations is complete . A transformation is said to be local if it 
can be applied to any subgraph without any knowledge of the structure with- 
in which the graph is embedded. Otherwise we pay that *.he transformation 
is global. A set of transformations is said to be complete if whenever the 
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Fig. 4. 6 Alternative Form of a Transformation Scheme 
Which Does Not Preserve Equivalence 
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criterion function has a minimum (maximum), there is a sequence of 
transformations which obtains a graph exhibiting this minimum (maximum) 

value. 

The transformation schema shown in Figure 4.4 satisfy each of the 

above conditions when the problem is to minimize the number of functional 
data operators in a simple cycle free graph consisting solely of nodes 
with one output and either one or two inputs. In order to include cycle free 
graphs with selectors and junctions, we may augment the set of transforma- 
tions to include subgraphs with control links with or without selector nodes. 
The transformation scheme 4 in Figure 4. 5 serves to illustrate a case in 
which care should be exercised in order to guarantee that the transforma- 
tions are in fact local. An apparently reasonable alternative to this scheme 
is shown in Figure 4. 6, however, this transformation is not local as can 
be verified by considering the graph of Figure 4. 7. When transformation 
4 is applied to both instances of selector (3^ there results the graph of 
Figure 4. 7b which obviously cannot be equivalent to the original since it 
contains a cycle without any loop junction and therefore has hang -up states. 
Scheme 4 in Figure 4. 5 avoids this difficulty by applying the control links 
labelled 3 and 4 in such a way that every path of the transformed graph is 

also a path of the original. 

As an example of a problem which appears to be inherently global 
consider the transformation of a graph with the objective that a function or 
predicate is applied in an execution sequence only if the results of its 
application will be used by another computation during the execution. This 
objective can be achieved simply by moving the point of application of 
chosen control links. For example, in the graph of Figure 4. 8a, operators 

f and f, will be applied under all circumstances. However, their results 
1 ^ 
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(a) 




(b) 



Fig. 4. 8 Two Equivalent Program Graphs Differing on 
the Way a Control Link is Applied to Operatoi 
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will be used by operate, f, only if P" is enabled. To eliminate this 
condition, the control lin k p" is applied at both f, and h a, shown in 
Figure 4. 8b. The equivalence of both graphs is readily established. To 
see that this transformation is in fact global, imagine that there is a path 
from f 2 to p r » this is the case, applying the control Una pj to f, creates 
a cycle and the resulting graph is not equivalent to the original. Since the 
path from f, to p, can be of arbitrary length, there is no single finite ruie 
that can accomplish this transformation. 



V. CONCLUSIONS AND RECOMMENDATIONS 

We have presented a deterministic model for the representation of 
parallel computations on non-structured data. The model incorporates 
data^iependent decisions and sufficient apparatus for precisely defining 
cyclic structures. Methods of analysis have been developed and a simple 
characterization of the hang-up states of a computation has been given. 
An equivalence problem for the model has been formulated and solved. 

The main weakness of the model is its inability to represent 
computations on structured data. Further research is needed to determine 
whether the same conceptual framework used in this paper can be adapted 
to represent relations between an unbounded memory and a finite sequencing 

and control structure. 

The results obtained in Chapter IV regarding the equivalence of 

15 
program graphs suggest several areas of future research. McCarthy nas 

proposed that the formulation of a theory of equivalence is a basic step 

towards the development of a theory of programming. Very little progress 

has been made towards a satisfactory selection of this problem. Undoubtedly 

the difficulty of the general problem is related to the known unsolvability 

results of every computational model so far proposed, e. g. Turing 

machines, \ -calculus, Markov algorithms, etc If we separate the 

computational aspects of a program from the pure control aspects, we can 

identify at least two sources of unsolvable problems. On one hand, it may 

be that the decision problem of the functional calculus for a given set of 

primitive functions and predicates is itself unsolvable. In this case, the 

equivalence problem is unsolvable even for the simplest programs, i. e. 

cycle-free programs. On the other hand, even if the aforementioned 

decision problem is solvable, it may be that the iterative or recursive 

-106- 
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structures expressible in the model give rise to unsolvable combinational 
problems. We have often looked at the combination of these two effects 
as permitting just too many ways of representing processes that do nothing. 
In our formulation both of these difficulties are avoided by 1) defining 
equivalence in terms of the identity of certain strings, and 2) allowing just 
one way of doing nothing, the identity function, and this in a manner which 
is easily detected. The equivalence obtained is too strong and ways must 
be sought to obtain weaker conditions. 

It appears that under certain circumstances, the criterion given 
in Chapter IV may supply sufficient conditions for weaker forms of equiva- 
lence, i. e. if one can show that to each base sequence of one graph one 
can find an equivalent sequence of the other and vice versa, then the two 
programs are equivalent. It would be of interest to determine under what 
circumstances, if any, this conjecture holds. Also, there are some 
similarities between that criterion and the recursion -induction principle 

~ ,15 
formulated by McCarthy. 

From the point of view of computational linguistics, a program 
graph may be considered as the definition of a grammar whose terminal 
symbols are the labels associated with the operators of the graph. The 
languages generated by these grammars include the finite-state languages 
but are not limited to that class. McNaughton 16 has studied the class of 
languages generated by parentheses grammars which are in turn a subset 
of the backward deterministic grammars. He has shown that the equiva- 
lence problem for parentheses grammars is solvable. It would be of 
interest to investigate the relationship between program graph-like 
grammars and either parentheses or backwards deterministic grammars. 
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Finaliy, the model and methods of analysis developed in this 

p .per should be useful in the study of problems arising in the design of 

asynchronous multiprocessor computer systems. In particular, the 

relatively small number of node types with which determinism is achieved 

3, 18,22 
-institute a workable basis for the design of macromodular systems. 



AN ALGORITHM TO GENERATE BASE SEQUENCES 

APPENDIX A 

The algorithm described in this section generates all base 
sequences of a program graph without hang-up states and/or infinite 
cycles. If the program graph does not satisfy these conditions, an 
appropriate diagnostic is produced and the algorithm stops. 

The generation of the base sequences is accomplished by simula- 
ting all possible execution sequences during which no proper cycle is 
reported more than once. The finiteness of the graph guarantees that the 

process eventually stops. 

We assume a suitable representation of the program graph which 
allows for storing the state of the graph, i. e. the value and status of every 
link. In addition, five separate structures are used to keep track of the 
state of the simulation. These five structures are: 

1. The selector choice list (C-list). 

2. The selector value list (V-list). 

3. The proper cycle list (P-list). 

4. The dynamic enabling function (DEF). 

5. The environment stack (E-stack). 

C-list The C-list contains an entry for every selector in the graph. 
Associated with each entry is a list containing the possible outcomes of the 
application of the selector function, i. e. which output connector to enable. 
Initially, this list contains »+' and '-' for every entry in the C-list. 

V-list The V-list contains an entry for every distinct selector 
label in the graph. Associated with each entry is a list of all outcomes of 
a selector having this label. The entries of these sublists also contain the 
input values corresponding to the outcome, e. g. +tf ^(x, y)), z). Initially, 
these sublists are empty for every entry in the V-list. 

- 1 09 - 
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P-list The P-list contains an entry for every proper cycle of the 
graph. Associated with each entry is a list of all links contained in the 
cycle. Each entry in these sublists have a count field which is initially set 

to zero. 

DEF The DEF is a variable containing the dynamic enabling function 

for the simulated execution sequence. 

The state of the graph, C-list, V-list, P-list, and DEF are collectively 
referred to as the environment . 

E-stack The E-stack is a last-in-first-out list. . Each entry in 

the E-stack is an environment. 

It is convenient to define the following operations: 

1. Scan i, n. 

This operation scans the graph looking for a node in an active 
configuration. For this purpose it is assumed that the nodes 
are ordered. The scan always starts at the first node. When 
an active node is found, the variable i is set to point to this 
node and control is transferred to the step following the scan. 
If no active node is found, control is transferred to the step 
labelled n. . 

2. Stack * 



This operation obtains a copy of the environment and places it 
on top of the E-stack. The current environment remains 
unchanged. 
3. Pop n. , n 2 

This operation removes the top element from the E-stack and 
installs it as the current environment. A successful performance 
of the operation transfers control to the step labelled nj. If the 
operation cannot be performed because the E-stack is empty, 
control is transferred to the step labelled n^. 



4. O utcome i, n^, n^ 

This operation picks a number from the list of outcomes found 
in the entry of the C-list corresponding to i which must point 
to a selector. If the list of outcomes is empty, control is trans- 
ferred to the step labelled n.,. Otherwise, the outcome chosen is 
deleted from the list and the V-list is checked to verify that it is 
an allowable outcome for the selector i, i. e. if the outcome 
chosen is • + • and the input value is y , -(y) should not appear in 
the V-list. If the outcome is not allowed, the process is repeated. 
If the outcome is allowed the following sequence of operations is 
performed: 

a. if outcome list is not empty, stack . 

b. the outcome and input values are added to the V-list 

entry of i. 

c. the DEF is augmented with the chosen selector value. 

d. an indication of the desired outcome is set in the node. 

e. control is transferred to the step labelled iij. 
5. Do transition i, n^, n^ 

This operation updates the state of the graph according to the 
transition table for the node pointed to by i. If i is a selector, 
the information set by step 4 of outcome is used. After updating 
the status and possibly the value of the links involved* the sub- 
lists of the P-list are searched for all instances of links which 
have been newly enabled. For each such instance found the count 
field is incremented by one. If this causes all members of a 
sublist to have a count greater than one, control is transferred 
to label n,. Otherwise, control goes to label rij. 
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6. Reset C The list of outcomes for all members of the 

C-liat is initialized. 
In terms of the above operations the algorithm is written as 

follows: 

1. scan i, 13 

2. if i is not a selector, loop junction, or final node, go to step 8 

3. if i is a final node, go to step 1 1 

4. if is is a loop junction, go to step 7 

5. if the active configuration of the selector does not require a 
functional application, go to step 8 

6. outcome i, 8, 15 

7. if the status of the loop junction inputs is blocked and enabled 
respectively, reset C 

8. do transition i, 1, 9 

9. pop E 1, 15 

10. pop E 1, 16 

11. write DEF and value as a base sequence 

12. go to step 8 

13. if all links are in IDLE status, go to step 10 

14. report hang-up statp and halt 

15. report infinite cycle and halt 

16. report successful completion and halt. 

The algorithm generates all the base sequences by trying all allow- 
able combinations of selector values. This is accomplished in step 6 by 
stacking the environment as it existed prior to every selector application. 
Before the stacking is performed, a note is made that a certain branch has 
been taken by removing the chosen selector outcome from the corresponding 



-113- 



C-liat entry. Upon successful completion of a base sequence (step 13), th. 
environment is restored to the point of the last selector application and the 
process continues. If at this point the E-stack is empty, all alternatives 
have been tried. At step 7, all outcomes are rehabilitated upon the occur- 
rence of any cycle. All sequences which are not base sequences will 
eventually be caught in step 8. When this occurs, step 9 discards the 
current sequence and tries an alternative one. Note that if at this point no 
alternative is present, it can only mean that under no circumstances can 
<he cycle be disabled and this is reported as an infinite cycle. 

A similar situation occurs if in step. 6 no allowable outcome can be 
found. In this case however, the infinite cycle may be caused by previously- 
chosen selector outcomes and need not occur for all execution sequences. 

A hang-up state is reported whenever an active node cannot be found, 
yet these are links in a status other than IDLE. 



VERIFICATION OF PROPERTIES OF THE TRANSITION TABLES 

APPENDIX B 

In this Appendix we verify properties a, b, c, d, and e of the 
transition tables in Table 2. 1. These properties have been used in the 
proof of Theorem 3. 8. If t is a link, [ i ] denotes the number of times 
that i is enabled or disabled during an execution sequence. 

Property a. For every loop junction-loop output pair of a simple 
graph (see Figure 3.9), [ i j] = [* e ] ift I x and i 3 are idle. 

Proof: By lines 1 and 2 of the transition table for loop outputs, 
i, can be enabled or disabled only if i-j is enabled. By line 8 of the transi- 
tion table for loop junctions, i 3 can be enabled only if i 2 ia disabled and 
i is blocked. By lines 1 through 6 of this same table, 1 ^ is enabled or 
disabled. Therefore, I , is enabled or disabled at most once for each 
time that I , is enabled or disabled. 

First, assume that [ij] =[i 6 ] . If [i j ] = then t 1 and 1 3 are 
necessarily idle since their status must be identical to that occurring in 
the initial state. Therefore, assume [tj =[i 6 ] * 0. The next to the 
last status of i, must have been enabled. For, otherwise, by lines 3,4, 
5, and 6 of the loop output transition table and the argument of the previous 
paragraph [ i ] =[ t A + 1 . Thus, the last transition of the loop output was 
either line 1 or line 2 of the table and t^ is in idle status. Also, if i 3 was 
last enabled, by line 8 of the loop junction table, ij is also in idle status. 
This verifies the first part of the property. Now assume both t ^ and * 3 
are in idle status. If /, has been in enabled or disabled status at all, 
the last transition of the loop junction must have been line 8 of its table, 
which we have Been can occur at most once for every time I j is enabled 
or disabled. Thus, the last transition of the loop output must have been 
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either line 1 or line 2 of its table. Thus, 1 & must have been enabled 
or disabled once for each time l y has been enabled or disabled, i. e. 
t i ] = [ i, ]. This verifies the second part of the property. 

Q. E. D. 

Property b. For every loop junction of a simple graph, if I j 
is idle, then[i 2 ]=[! 4 ] iff [i 2 ]=[ i 3 ] and both i 2 and i 4 are idle. 

Proof: First, assume [i 2 ]=[i 4 l= 0. By lines 1 through 6 of 
the transition table, it is clear that [ ij = and, therefore, [ I J = 0. 
Furthermore, * 4 must be idle and since the graph is simple, by Lemma 
3. 4, there is a proper path containing l^ and i^, and, by Corollary 3. 2, 
i 2 isidle. Now, assume [i 2 ]=[i 4 ] )^ 0. By Lemma 3. 4 and Corollary 
3. 2, I. is enabled or disabled after i v so that the only possible con- 
figurations of the loop junction are 2-1 - - , 2 1--, or 00-0. But since 
I is idle, only the last configurations, i. e. or 1 are allowed. 
In any event, i 3 is disabled or enabled and, by lines 2, 3, 5, 6, 7, and 8 of 
the loop junction table, I ^ is enabled or disabled every time that 
i had been in those statuses. Therefore, [ t z ] = U3] and 1 2 and t^ are 
idle. This shows the first part of the property. Next, assume [i 2 ] =[ 1 3] 
and both i 2 and i 4 are idle. By the transition table, the last transition 
of the loop junction must have been line 8. Therefore, by the same 
argument used above, [i 2 ] = [ * 4 ] • 

Property c. For every loop junction of a simple graph, if I ^, l^' 

ly and i 4 are idle, then[! 2 ] =[ 1 ^] = [* 4 ] • 

Proof: First, assume^]* 0. Then [t^] =[ l£ = and by 
Lemma 3.4 and Corollary 3.2, [i 2 ] = also. Now, assume [ I x ] t 0, 
Since !., I?, and i . are idle, the last transition of the loop junction 
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must have been line 8 of its table. By property b, [i 2 ] = l *■ a\ » an< * 
by lines 2, 3, 5, 6, 7, and 8 of the loop junction table, [i 2 l ~i ^3] • This 
shows that [ i 2 J =[ 1 3] = M 4 ] • 

Q. E. D. 
Property d. All input links of an operator, selector, junction, 
or loop output have been enabled or disabled the same number of times 
iff each input link is idle or each is enabled or disabled. 

Proof: For operators, selectors, and junctions the property is 
easily verified by noting, in Table 2. l.that all active configurations of 
these nodes require all inputs to be enabled or disabled, and that the 
completion of a transition places all the inputs in idle status. 

In the case of loop outputs, lines 3,4, 5, and 6 do not have this 
property. Lines 3 and 4 satisfy an equivalent condition since the transi- 
tion places the input links in a status other than enabled or disabled. 
Thus, all it remains is to verify the property for lines 5 and 6, i. e. 
the active configurations 2 10 and 2-1 . In both of these cases the link 
in enabled or disabled status remains in that condition after the transition. 
It follows that if all the input links are enabled or disabled the same number 
of times one of the active configurations 1, 2, 3, or 4 must eventually 
occur. Conversely, if all input links are id}e, or either enabled or dis- 
abled this last condition must have occurred the same number of times, 
Bince consecutive occurrences of the configurations of lines 5 or 6 must 
eventually yield to one of the others. 

Q. E. D. 
Property e. If I. and i . are input and output links, respectively, 
of the same operator, selector, or junction, then [l,] = (1 .] iff i. is 
idle. 
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Proof: An examination of Table 2. 1 yields that an output link of 
i node can become enabled or disabled only if all inputs to that node have 
been enabled or disabled. Furthermore, the transitions that effect a 
change of output status place the input links in idle status. This is suf- 
ficient to verify both parts of the property. 



1. 



BIBLIOGRAPHY 

Busacker, R. G. and Saaty, T. L. . Finite Graphs and Networks. 
McGraw Hill, New York (1965). 

2. Bohm, E. and Jacopini, G. , Flow Diagram s. Turing Machines 

and Languages with Onlv Two Formation Rules, Comm; ACM 
Vol. 9, No. 5 (May, 1966), pp. 366-371. 

3. Clark, W. A. , Macromodular Computer Systems, AFIPS Conference 

Proceedings, (SJCC) Vol. 30, Thompson Books, Washington, 
D. C. (1967) pp. 335-336. 

4. Cooper, D. C. , Computer Programs and Graph Transformations, 

Center for the Study of Information Processing, Carnegie 
Institute of Technology (1966). 

5. Ershov, A. P. , Operator Algorithms I, Problems of Cybernetics 

III, Pergamon Press (1962) pp. 697-763. 

6. Estrin G. and Turn, R. , Automatic Assignment of Computations 

in a Variable Structure Computer System, IEE Transactions 
on Electronic Computers, Vol EC-12, No. 5 (Dec. 1963), 
pp. 755-773. 

7. Holt, A. W. . Notes for Computer and Prog ram Organization, 

Engineering Summer Conference, University of Michigan. 
(June 1966). 

8. Ianov, Y. I. , On the Logical Schemata of Algorithms , Problems 

of Cybernetics I, Pergamon Press (I960), pp. 75-127. 

9. Karp, R. M. , A Note on The Application of Gr aph Theory to 

Digital Computer Programming , Information and Control, 
Vol. I, (June, 1960), pp. 179-190. 

-118- 



-119- 

10. Karp, R. M. and Miller, R. E. . Properties of a Model for 

Parallel Computations: Determinary, Termination, Queueing, 
SIAM J. Appl. Math., Vol. 14, No. 6 (Nov. 1966), pp. 1390- 
1411. 

11. Kaluzhnin, L. A., Algorithmization of Mathematical Problems , 

Problems of Cybernetics II, Pergamon Press (1961), 
pp. 371-391. 

12. Malhotra, A. , Asynchronous Control of Computer Operations , 

S. M. Thesis, Sloan School of Management, M. I. T. (Feb. 1967). 

13. Marimout, R. B. , Application of Graphs and Boolean Matrices 

to Computer Programming , SIAM Review,, Vol. 2, No. 4 
(Oct. I960) pp. 259-268. 

14. Martin, D. F. , The Automatic Assignment and Sequencing of 

Computations on Parallel Processor Systems, Report No. 66-4, 
Department of Engineering, University of California, Los 
Angeles, (January 1966). 

15. McCarthy, J., A Basis for a Mathematical Theory of Computation , 

Proc. Western Joint Computer Conference, Vol. 19, (1961), 
pp. 225-238. 

16. McNaughton, R. , Parenthesis Grammars, Journal ACM, Vol. 14, 

No. 3 (July 1967), pp. 490-500. 

17. Muller, D. E. and Bartky W. S. , A Theory of Asynchronous 

Circuits, Proc. of an International Symposium on The Theory 
of Switching, The Annals of the Computation Laboratory of 
Harvard University, Vol. 29, Part I, Harvard University Press 
(1959), pp. 204-243. 



18. 



-180- 

Ornatein. S. M. , Stucki, M. J. , and Clark, W. A. . A Functional 
Description of Macromodules , AFIPS Conference Proceedings 
(SJCC) Vol. 30, Thompson Books, Washington, D. C. (1967), 
pp. 337-355. 

19. Petri, C. A., Communication with Automata , Memorandum 

MAC-M-212, Project MAC, M.I.T., Translation of: 
Kommunikation mit Automat en, Institut fur Angewandte 
Mathematik der Universitat Bonn, Wegelerstrasse 10, Bonn (1962). 

20. Prosser, R. T. , Application of Boolean Matrices t o the Analysis 

of Flow Diagrams, Proc. Eastern Joint Computer Conference 
Spartan Books (1959), pp. 133-138. 

21. Rutledge, J. D. , On Ianov's Program Schemata , Journal ACM, 

Vol. 11, No. 1 (Jan. 1964), pp. 1-9. 

22. Stucki, M.J. , Ornstein, S. M. , and Clark, W. A. , Logical Design 

of Macromodules , AFIPS Conference Proceedings (SJCC) Vol. 30, 
Thompson Books, Washington, D. C. (1967), pp. 357-363. 

23. Van Horn, E. C. , Computer Design for Asynchronously Rep roducible 

Multiprocessing , Ph. D. Thesis, Department of Electrical 
Engineering, M. I. T. , (Sept. 1966). Also Report MAC-TR-34, 
Project MAC, M. I. T. 



CS-TR Scanning Project 
Document Control Form 

Report # Lc^-Tc^ CH 



Date : AjJtdlL 



Each of the following should be identified by a checkmark: 
Originating Department: 

□ Artificial Intellegence Laboratory (Al) 
s ^ Laboratory for Computer Science (LCS) 

Document Type: 

^JS^ Technical Report (TR) □ Technical Memo (TM) 

□ Other: 

Document Information Number of pages: /^(JJ^-/^^ 

wwuiiiw No t to inclua>DODfom*, renter Wstru^ 

Originals are: Intended to be printed as : 

□ Single-sided or □ Single-sided or 

X Double-sided & Double-sided 

Print type: 

□ Typewriter □ OffsetPress □ LaserPrint 

Q InkJet Printer jrf Unknown Q Other" 

Check each if included with document: 

^3. DOD Form □ Funding Agent Form 

□ Spine D Printers Notes 

□ Other: 

Page Data: 



j2£ Cover Page 
□ Photo negatives 



Blank Pages- k^" f hf / fto< TXl£ TNk* 

Photographs/Tonal Material (byp^.«mn»o: 



Other (note <*MCnt*on/p«9« number)' 

Description . Page Number. 

i/T -\l-^° 



Scanning Agent Signoff: 

Date Received: dL/<^/^ Date Scanned: _ij2zJ^l- 



Scanning Agent Signature:. 



r U,<LQ1v>cJL 



Date Returned: JUJL/J&. 



RsvW94 DS/L.CS Docunwnt Control Fom> ert*xm.v*<J 



Project MAC — Technical Report Abstract 



1. ORIGINATING ACTIVITY 



Massachusetts Institute of Technology 
Project MAC 



3. REPORT TITLE 



2a. REPORT SECURITY CLASSIFICATION 

UNCLASSIFIED 



A Graph Model for Parallel Computations 



4. DESCRIPTIVE NOTES 



Technical Report (the unaltered MIT Doctor of Science thesis, submitted S ept. 1969) 

9. AUTHOR(S) _ ' ~ 



Rodriguez, Jorge E 



6. REPORT DATE 

September, 1969 



8a. CONTRACT OR GRANT NO. 

Office of Naval Research, Nonr-4102 (01) 

b. PROJECT NO. 

NR-048-189 
RR 003-09-01 



TOTAL NO. OF PAGES 

133 



7b. NO. OF REFS 

23 



9a. ORIGINATOR'S REPORT NUMBER 

MAC TR-64 ESL-R-398 



9b. OTHER REPORT NO. 

AD 697 759 



.o. ava,lab,l,ty/l,m,tat,on notices Defense Contractors may obtain from: Defense Documentation 
Center, Defense Supply Agency, Cameron Station, Alexandria, VA 22314* 

Others from: Clearinghouse for Federal Scientific and Technical Information (CFSTI) 
Sills Building, 5285 Port Royal Road, Springfield, VA 22151 



11. SUPPLEMENTARY notes 



12. SPONSORING MILITARY ACTIVITY 



None 



Air Force Manufacturing Advanced Research Projects 
Technology Laboratory, RTD Agency, 3D-200 Pentagon 
Wright-Patterson AFB Washington, D.C. 20301 



13. ABSTRACT 



This report presents a computational model called program graphs which 
makes possible a precise description of parallel computations of arbitrary complexity 
on non- structured data. In the model, the computation steps are represented by the 
n ° des of a directed graph whose links represent the elements of storage and trans- 
mission of data and/or control information. The activation of the computation repre- 
sented by a node depends only on the control information residing in each of the links 
incident into and out of the node. At any given time any number of nodes may be 
active, and there are no assumptions in the model regarding either the length of time 
required to perform the computation represented by a node or the length of time re- 
quired to transmit data or control information from one node to another. Data de- 
pendent decisions are incorporated in the model in a novel way which makes a sharp 
distinction between the local sequencing requirements arising from the data dependen- 
cy of the computation steps and the global sequencing requirements determined by the 
logical structure of the algorithm. 



14. KEY WORDS 



Program Graphs 
Parallel Computations 
Computation Models 



*No 



copies are available from Project MAC. 



Scanning Agent Identification Target 



Scanning of this document was supported in part by 
the Corporation for National Research Initiatives, 
using funds from the Advanced Research Projects 
Agency of the United states Government under 
Grant: MDA972-92-J1029. 



The scanning agent for this project was the 
Document Services department of the M.I.T 
Libraries. Technical support for this project was 
also provided by the M.I.T. Laboratory for 
Computer Sciences. 






MULT. Libraries 



daiptrgtwpw Rev. 9/94 



